-- Logs begin at Fri 2022-01-28 01:08:37 UTC, end at Fri 2022-01-28 02:24:59 UTC. -- Jan 28 01:56:44.999425 dv-cinder-824977-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jan 28 01:56:45.010198 dv-cinder-824977-1-iscsi devstack@n-api.service[101384]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jan 28 01:56:45.012183 dv-cinder-824977-1-iscsi devstack@n-api.service[101384]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jan 28 01:56:45 2022] *** Jan 28 01:56:45.012183 dv-cinder-824977-1-iscsi devstack@n-api.service[101384]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jan 28 01:56:45.012183 dv-cinder-824977-1-iscsi devstack@n-api.service[101384]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jan 28 01:56:45.012183 dv-cinder-824977-1-iscsi devstack@n-api.service[101384]: nodename: dv-cinder-824977-1-iscsi Jan 28 01:56:45.012183 dv-cinder-824977-1-iscsi devstack@n-api.service[101384]: machine: x86_64 Jan 28 01:56:45.012183 dv-cinder-824977-1-iscsi devstack@n-api.service[101384]: clock source: unix Jan 28 01:56:45.012183 dv-cinder-824977-1-iscsi devstack@n-api.service[101384]: pcre jit disabled Jan 28 01:56:45.012183 dv-cinder-824977-1-iscsi devstack@n-api.service[101384]: detected number of CPU cores: 4 Jan 28 01:56:45.012183 dv-cinder-824977-1-iscsi devstack@n-api.service[101384]: current working directory: / Jan 28 01:56:45.012183 dv-cinder-824977-1-iscsi devstack@n-api.service[101384]: detected binary path: /usr/bin/uwsgi-core Jan 28 01:56:45.012183 dv-cinder-824977-1-iscsi devstack@n-api.service[101384]: your processes number limit is 47680 Jan 28 01:56:45.012183 dv-cinder-824977-1-iscsi devstack@n-api.service[101384]: your memory page size is 4096 bytes Jan 28 01:56:45.012183 dv-cinder-824977-1-iscsi devstack@n-api.service[101384]: detected max file descriptor number: 2048 Jan 28 01:56:45.013555 dv-cinder-824977-1-iscsi devstack@n-api.service[101384]: lock engine: pthread robust mutexes Jan 28 01:56:45.013555 dv-cinder-824977-1-iscsi devstack@n-api.service[101384]: thunder lock: enabled Jan 28 01:56:45.013555 dv-cinder-824977-1-iscsi devstack@n-api.service[101384]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jan 28 01:56:45.013555 dv-cinder-824977-1-iscsi devstack@n-api.service[101384]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Jan 28 01:56:45.057197 dv-cinder-824977-1-iscsi devstack@n-api.service[101384]: Python main interpreter initialized at 0x56028ac269c0 Jan 28 01:56:45.057197 dv-cinder-824977-1-iscsi devstack@n-api.service[101384]: python threads support enabled Jan 28 01:56:45.057197 dv-cinder-824977-1-iscsi devstack@n-api.service[101384]: your server socket listen backlog is limited to 100 connections Jan 28 01:56:45.057197 dv-cinder-824977-1-iscsi devstack@n-api.service[101384]: your mercy for graceful operations on workers is 90 seconds Jan 28 01:56:45.057556 dv-cinder-824977-1-iscsi devstack@n-api.service[101384]: mapped 403077 bytes (393 KB) for 2 cores Jan 28 01:56:45.057630 dv-cinder-824977-1-iscsi devstack@n-api.service[101384]: *** Operational MODE: preforking *** Jan 28 01:56:45.057880 dv-cinder-824977-1-iscsi devstack@n-api.service[101384]: *** uWSGI is running in multiple interpreter mode *** Jan 28 01:56:45.057880 dv-cinder-824977-1-iscsi devstack@n-api.service[101384]: spawned uWSGI master process (pid: 101384) Jan 28 01:56:45.058104 dv-cinder-824977-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jan 28 01:56:45.059006 dv-cinder-824977-1-iscsi devstack@n-api.service[101384]: spawned uWSGI worker 1 (pid: 101385, cores: 1) Jan 28 01:56:45.059006 dv-cinder-824977-1-iscsi devstack@n-api.service[101384]: spawned uWSGI worker 2 (pid: 101386, cores: 1) Jan 28 01:56:45.059182 dv-cinder-824977-1-iscsi devstack@n-api.service[101384]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jan 28 01:56:46.748613 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 28 01:56:46.748613 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: from cryptography.utils import int_from_bytes Jan 28 01:56:46.749353 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 28 01:56:46.749353 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: from cryptography.utils import int_from_bytes Jan 28 01:56:46.757863 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 28 01:56:46.757863 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: from cryptography.utils import int_from_bytes Jan 28 01:56:46.758361 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 28 01:56:46.758361 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: from cryptography.utils import int_from_bytes Jan 28 01:56:49.480964 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 28 01:56:49.482200 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 28 01:56:49.482355 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 28 01:56:49.482636 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 28 01:56:49.482891 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 28 01:56:49.483275 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.483596 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.483916 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.484258 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.484587 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.484894 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.485210 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.485526 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.485849 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.486106 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.486414 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.486734 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-824977-1-iscsi {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.487054 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.487358 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.487664 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.487855 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 28 01:56:49.488314 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.488421 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 28 01:56:49.488516 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.488598 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 28 01:56:49.488685 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.488887 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.488984 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 28 01:56:49.489180 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 28 01:56:49.489379 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.489571 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.489819 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.489920 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.490123 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.490215 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.490432 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.490522 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.490767 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.490872 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.491075 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.491164 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.491381 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.491469 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.491700 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.491799 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.492027 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.492135 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.492355 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.492443 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.492663 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.492748 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.493005 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-824977-1-iscsi {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.493095 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-824977-1-iscsi {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.493333 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.493482 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.493639 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.493768 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.493947 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.494037 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.494262 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.494346 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.494564 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.494648 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.494884 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.495011 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.495189 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.495275 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.495548 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.495691 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.495851 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.496017 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.496249 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.496334 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.496571 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.496655 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.496895 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.496990 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.497892 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.498078 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.498187 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.498374 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.498588 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.498724 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.498816 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.499042 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.499139 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.499345 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.499449 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.499649 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.499748 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.499899 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.500068 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-824977-1-iscsi {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.500230 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.500385 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.500550 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.500697 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.500869 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.501001 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.501191 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.501407 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.501492 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.501677 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.501770 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.501995 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.502079 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.502312 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.502406 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.502616 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.502708 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.502922 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.503007 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.503225 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.503334 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.503530 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.503635 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.503829 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.503920 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.504158 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.504259 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.504463 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.504557 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.504765 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.504849 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.505070 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.505154 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.505382 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.505472 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.505684 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.505767 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.505989 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.506076 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.506239 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.506325 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.506544 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.506684 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.79 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.506865 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.506957 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.79 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.507185 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.507269 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.507506 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.507600 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.507755 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.507848 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.508022 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.508166 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.508342 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.508485 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.508662 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.508801 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.508970 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.509105 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.509277 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.509410 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.509664 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.509848 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.509969 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.510039 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.510185 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.510325 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.510485 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.510652 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.510773 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.510858 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.511078 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.511163 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.511394 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.511478 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.511705 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.511797 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.512041 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.512128 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.512346 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.512432 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.512648 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.512747 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.512985 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.513263 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.79 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.513355 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.513631 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.513733 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.79 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.513933 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.514044 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.514235 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.514390 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.514537 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.514713 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.514839 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.515026 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.515140 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.515346 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.515432 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.515668 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.515762 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.516000 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.516088 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.516305 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.516389 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.516613 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.516708 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.516934 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.517018 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.517236 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.517319 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.517540 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.517627 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.517788 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.517880 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.518087 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.518171 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.518390 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.518523 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.518708 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.518793 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.519013 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.519104 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.519311 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.519396 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.519613 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.519704 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.519923 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.520040 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.520241 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.520331 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.520548 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.520639 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.520844 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.520933 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.521146 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.521236 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.521450 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.521552 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.521751 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.521842 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.522052 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.522136 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.522349 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.522439 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.522648 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.522732 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.522948 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.523041 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.523248 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.523332 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.523545 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.523721 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.523852 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.523966 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.524170 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.524279 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.524472 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.524579 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.524790 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.524882 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.525092 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.525183 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.525392 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.525491 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.525692 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.525785 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.525997 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.526087 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.526300 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.526404 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.526617 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.526708 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.526920 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.527012 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.527224 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.527324 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.527540 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.527639 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.527836 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.527928 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.528202 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.528362 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.528493 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.528698 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.528875 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.529029 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.529178 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.529319 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.529457 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.529563 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.529792 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.529918 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.530102 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.530350 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.530557 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.530649 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.530874 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.530960 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.531205 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.531298 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.531522 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.531607 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.531837 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.531935 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.532180 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.532267 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.532487 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.532571 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.532798 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.532891 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.533104 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.533189 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.533423 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:56:49.533509 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.533733 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.533829 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.534073 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.534178 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.534410 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.534502 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.534719 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.534812 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.535042 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.535138 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.535351 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.535447 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.535673 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.535767 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.535994 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.536082 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.536313 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.536398 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.536629 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.536730 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.536939 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.537032 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.537242 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.537326 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.537551 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.537637 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.537866 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.537949 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.538182 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.538266 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.538493 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.538578 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.538797 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.538880 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.539099 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.539183 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.539400 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.539493 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.539707 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.539793 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.540041 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.540128 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.540362 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.540454 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.540683 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.540774 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.540985 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.541078 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.541314 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.541399 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.541618 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.541704 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.541925 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.542018 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.542231 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.542315 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.542531 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.542616 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.542837 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.542934 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.543143 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.543228 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.543442 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.543535 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.543763 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.543857 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.544614 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.544737 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.544982 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.545189 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.545292 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.545515 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.545607 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.545856 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.545948 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.546176 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.546352 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.546482 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.546573 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.546793 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.546880 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.547099 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.547209 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.547408 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.547494 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.547715 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.547806 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.548041 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.548146 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.548366 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.548453 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.548691 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.548776 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.548996 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.549090 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.549318 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.549405 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.549624 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.549707 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.549937 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.550078 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.550235 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.550335 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.550539 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.550624 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.550838 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.550923 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.551139 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.551224 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.551440 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.551532 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.551744 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.551837 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.552069 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.552159 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.552373 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.552472 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.552673 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.552758 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.552976 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.553060 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.553277 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.553370 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.553588 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.553672 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.553891 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.553974 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.554193 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.554290 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.554493 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.554579 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.554797 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.554894 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.555115 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.555209 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.555423 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.555508 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.555754 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.555838 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.556112 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.556203 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.556528 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.556624 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.556747 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.556833 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.557070 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.557158 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.557386 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.557519 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.557690 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.557775 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.557998 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.558083 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.558302 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.558385 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.558602 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.558686 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.558904 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.559037 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.559209 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.559301 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.559512 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.559596 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.560549 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.560646 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.560779 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.561013 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.561098 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.561355 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.561442 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.561664 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.561750 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.561984 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.562077 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.562296 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.562381 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.562605 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.562697 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.562911 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.562996 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.563220 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.563314 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.563548 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.563632 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.563858 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.563942 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.564191 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.564278 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.564501 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.564586 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.564813 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.564934 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.565125 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.565215 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.565441 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.565543 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.565751 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.565853 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.566068 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.566160 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.566377 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.566469 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.566688 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.566787 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.567000 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.567092 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.567315 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.567407 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.567618 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.567719 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.567930 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.568062 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.568264 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.568355 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.568592 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.568701 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.568901 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.568991 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.569211 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.569301 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.569516 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.569628 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.569826 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.569912 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.570134 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.570221 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.570442 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.570529 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.570746 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.570831 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.571049 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.571143 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.571356 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.571443 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.571668 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.571753 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.571991 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.572217 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.572310 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.572379 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.572592 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.572687 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.572903 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.572998 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.573209 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.573295 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.573509 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.573596 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.573811 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.573905 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.574116 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.574215 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.574436 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.574529 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.574743 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.574836 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.575061 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.575166 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.575435 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.575527 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.575782 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.576042 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.576133 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.576421 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.576519 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.576729 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.576828 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.577036 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.577123 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.577338 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.577425 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.577639 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.577733 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.577969 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.578054 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.578275 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.578361 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.578575 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.578668 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.578880 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.578964 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.579187 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.579314 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.579493 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.579587 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.579804 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.579890 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.580137 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.580225 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.580443 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.580530 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.580746 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.580837 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.581060 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.581145 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.581365 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.581457 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.581670 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.581799 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.581973 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.582058 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.582276 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.582368 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.582583 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.582670 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.582896 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.582980 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.583202 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.583417 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.583491 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.583632 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.583801 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.584126 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.584227 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.584434 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.584573 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.584747 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.584958 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.585285 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.585381 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.585595 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.585682 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.585927 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.586012 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.586240 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.586341 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.586555 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.586722 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.586872 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.587042 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.587199 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.587353 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.587519 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.587673 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.587824 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.588067 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.588170 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.588429 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.588505 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.588735 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.588820 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.589036 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.589123 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.589342 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.589426 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.589641 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.589733 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.589941 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.590028 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.590245 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.590358 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.590546 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.590640 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.590844 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.590980 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.591234 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.591370 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.591551 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.591859 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.592037 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.592190 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.592286 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.592492 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.592578 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.592798 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.593137 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.593353 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.593440 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.593672 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.593757 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.593978 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.594072 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.594277 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.594362 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.594575 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.594863 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.594949 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.595252 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.595352 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.595487 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.595573 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.595810 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.595894 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.596155 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.596245 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.596477 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.596563 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.596798 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.596895 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.597105 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.597190 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.597420 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.597503 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.597721 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.597813 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.598023 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.598108 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.598323 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.598409 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.598626 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.598719 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.598928 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.599012 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.599228 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.599314 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.599531 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.599631 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.599833 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.599925 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.600165 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.600253 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.600469 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.600566 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.600766 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.600851 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.601070 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.601162 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.601374 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.601469 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.601683 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.601776 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.601984 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.602068 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.602283 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.602380 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.602583 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.602676 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.602886 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.602971 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.603188 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.603281 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.603489 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.603582 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.603789 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.603874 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.604110 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.604210 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.604426 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.604519 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.604726 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.604812 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.605025 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.605120 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.605330 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.605452 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.605635 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.605745 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.605937 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.606037 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.606235 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.606333 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.607088 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.607244 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.607401 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.607699 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.607797 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.608026 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.608126 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.608323 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.608432 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.608624 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.608722 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.608929 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.609025 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.609250 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.609360 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.609588 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.609690 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.609857 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.609969 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.610164 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.610278 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.610465 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.610583 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.610763 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.610863 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.611062 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.611166 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.611366 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.611463 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.611666 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.611769 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.611964 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.612109 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.612287 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.612386 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.612590 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.612695 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.612888 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.612975 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.613195 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.613280 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.613498 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.613591 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.613797 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.613883 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.614096 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.614181 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.614394 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.614492 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.614701 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.614786 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.615007 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.615101 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.615314 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.615429 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.615628 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.615727 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.615933 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.616047 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.616262 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.616358 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.616571 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.616656 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.616880 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.616973 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.617181 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.617274 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.617486 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.617570 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.617788 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.617871 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.618090 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.618178 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.618396 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.618480 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.618697 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.618790 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.619000 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.619087 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.619307 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.619391 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.619613 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.619736 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.619915 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.620024 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.620245 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.620342 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.620548 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.620646 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.620855 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.620941 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.621158 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.621243 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.621461 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.621555 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.621763 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.621848 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.622065 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.622247 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.622449 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.622561 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.622757 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.623060 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.623153 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.623366 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.623452 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.623673 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.623761 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.623993 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.624081 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.624306 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.624425 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.624609 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.624702 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.624915 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.625008 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.625220 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.625315 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.625522 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.625627 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.625845 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.625941 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.626151 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.626245 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.626451 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.626539 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.626757 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.626844 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.627058 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.627151 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.627367 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.627459 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.627670 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.627757 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.627991 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.628124 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.628311 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.628419 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.628618 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.628729 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.628924 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.629033 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.629248 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.629333 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.629562 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.629648 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.629872 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.630004 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.630194 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.630280 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.630518 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.630606 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.630846 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.630933 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.631151 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.631237 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.631463 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.631548 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.631776 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.631863 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.632115 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.632204 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.632417 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.632587 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.632725 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.632818 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.633031 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.633122 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.633334 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.633430 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.633636 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.633721 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.633940 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.634025 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.634246 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.634338 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.634550 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.634636 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.634868 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.634962 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.635245 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.635340 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.635554 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.635640 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.635861 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.635952 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.636205 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.636292 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.636511 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.636606 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.636820 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.636912 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.637125 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.637219 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.637434 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.637519 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.637741 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.638363 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.638680 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.638906 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.638992 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.639288 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.639372 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.639601 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.639694 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.639913 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.640019 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.640248 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.640333 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.640561 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.640648 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.640865 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.640956 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.641184 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.641269 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.641492 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.641579 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.641804 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.641910 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.642125 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.642210 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.642525 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.642608 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.642838 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.642925 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.643145 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.643229 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.643449 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.643535 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.643768 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.643853 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.644094 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.644194 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.644400 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.644487 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.644705 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.644790 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.645006 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.645099 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.645308 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.645401 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.645626 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.645710 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.645925 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.646017 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.646233 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.646358 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.646539 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.646675 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.646843 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.646985 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.647143 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.647401 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.647486 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.647716 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.647811 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.648066 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.648152 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.648391 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.648567 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.648701 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.648789 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.649019 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.649119 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.649324 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.649410 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.649629 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.649726 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.649938 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.650071 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.650243 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.650335 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.650543 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.650628 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.650842 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.650937 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.651141 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.651227 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.651474 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.651565 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.651774 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.651867 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.652121 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.652213 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.652441 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.652526 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.652768 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.652890 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.653078 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.653257 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.653451 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.653795 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.653928 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.654148 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.654423 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.654516 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.654747 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.654834 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.655076 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.655171 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.655382 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.655468 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.655687 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.655829 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.656009 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.656098 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.656320 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.656405 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.656626 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.656751 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.656932 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.657020 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.657240 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.657327 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.657542 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.657644 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.657846 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.657933 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.658148 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.658234 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.658451 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.658543 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.658762 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.658853 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.659070 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.659164 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.659380 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.659477 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.659683 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.659771 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.660028 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.660156 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.660312 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.660407 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.660634 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.660719 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.660947 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.661033 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.661257 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.661350 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.661563 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.661650 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.661871 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.661957 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.662176 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.662264 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.662492 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.662577 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.662810 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.662896 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.663124 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.663217 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.663437 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.663524 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.663752 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.663846 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.664090 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.664178 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.664408 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.664504 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.664722 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.664816 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.665034 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.665120 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.665343 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.665429 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.665657 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.665751 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.665971 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.666057 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.666286 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.666372 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.666645 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.666811 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.666954 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.667142 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.667265 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.667456 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.667574 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.667767 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.667886 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.668104 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.668217 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.668416 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.668515 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.668725 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.668821 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.669662 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.669768 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.669859 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.670162 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.670302 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.670469 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.670588 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.670794 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.670959 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.671111 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.671199 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.671434 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.671531 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.671766 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.671866 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.672105 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.672194 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.672419 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.672505 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.672731 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.672830 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.673042 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.673136 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.673384 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.673476 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.673694 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.673782 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.673999 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.674086 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.674309 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.674395 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.674621 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.674709 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.674933 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.675020 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.675242 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.675332 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.675551 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.675639 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.675860 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.675953 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.676196 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.676341 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.676505 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.676600 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.676812 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.676899 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.677125 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.677218 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.677431 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.677516 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.677746 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.677838 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.678074 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.678267 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.678391 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.678596 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.678702 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.678911 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.679004 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.679227 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.679314 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.679539 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.679811 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.679896 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.680152 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.680242 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.680481 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.680556 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.680794 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.680888 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.681106 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.681200 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.681417 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.681504 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.681731 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.681815 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.682054 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.682142 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.682359 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.682451 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.682660 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.682759 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.682968 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.683060 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.683273 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.683362 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.683575 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.683671 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.683894 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.683999 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.684291 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.684435 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.684612 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.684926 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.685119 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.685220 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.685433 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.685563 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.685885 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.685972 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.686203 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.686288 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.686520 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.686617 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.686833 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.686921 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.687149 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.687243 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.687465 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.687550 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.687781 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.687868 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.688120 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.688210 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.688433 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.688531 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.688739 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.688832 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.689053 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.689139 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.689364 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.689458 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.689669 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.689755 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.689972 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.690058 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.690281 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.690380 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.690588 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.690673 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.690890 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.691109 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.691196 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.691427 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.691514 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.691764 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.691851 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.692109 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.692208 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.692415 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.692502 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.692718 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.692803 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.693026 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.693120 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.693326 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.693413 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.693629 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.693715 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.693935 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.694030 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.694236 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.694322 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.694543 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.694628 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.694844 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.694942 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.695150 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.695243 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.695449 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.695535 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.695755 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.695841 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.696077 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.696178 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.696384 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.696511 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.696684 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.696915 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.697002 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.697380 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.697490 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.697594 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.697691 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.697912 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.698006 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.698220 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.698306 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.698542 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.698636 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.698853 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.698940 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.699162 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.699254 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.699477 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.699563 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.699788 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.699873 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.700127 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.701045 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.701286 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.701381 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.701554 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.701713 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.701869 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.702057 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.702188 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.702401 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.702487 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.702713 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.702800 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.703024 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.703118 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.703331 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.703424 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.703655 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.703741 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.703966 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.704083 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.704294 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.704380 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.704603 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.704687 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.704914 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.705002 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.705223 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.705316 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.705528 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.705613 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.705836 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.705922 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.706144 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.706237 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.706453 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.706548 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.706766 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.706855 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.707089 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.707181 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.707395 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.707495 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.707708 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.707794 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.708033 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.708134 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.708346 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.708443 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.708653 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.708739 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.708960 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.709044 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.709270 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.709364 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.709573 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.709658 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.709885 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.709969 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.710194 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.710293 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.710514 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.710599 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.710815 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.710909 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.711126 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.711236 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.711474 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.711562 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.711794 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.711878 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.712184 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.712494 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.712591 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.712819 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.712962 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.713134 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.713229 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.713515 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.713608 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.713764 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.713850 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.714073 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.714167 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.714404 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.714491 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.714744 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.714839 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.715067 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.715153 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.715383 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.715468 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.715689 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.715775 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.716162 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.716258 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.716630 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.716760 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.717047 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.717153 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.717367 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.717453 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.717683 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.717769 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.718255 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.718357 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.718570 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.718656 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.718890 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.718976 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.719200 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.719298 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.719525 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.719612 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.719846 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.719939 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.720193 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.720280 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.720505 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.720599 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.720815 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.720900 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.721127 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.721214 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.721436 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.721534 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.721746 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.721832 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.722053 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.722138 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.722363 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.722448 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.722671 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.722767 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.722979 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.723065 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.723308 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.723392 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.723613 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.723707 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.723937 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.724043 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.724277 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.724372 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.724595 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.724694 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.724908 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.724994 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.725217 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.725302 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.725544 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.725631 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.725853 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.725945 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.726161 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.726247 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.726466 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.726600 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.726776 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.726914 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.727090 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.727176 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.727402 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.727490 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.727732 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.727816 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.728064 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.728153 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.728374 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.728493 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.728687 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.728807 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.729024 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.729280 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.729369 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.729652 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.729738 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.729963 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.730048 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.730289 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.730384 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.730555 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 28 01:56:49.730647 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.730910 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.731280 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.731610 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.732144 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.732598 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.732914 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.733231 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.733546 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.733858 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.734170 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.734482 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.734818 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.735143 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.735448 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.735774 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.736116 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.736440 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.736753 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.737064 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.737393 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.737707 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.738022 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.738333 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.738643 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.738961 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.739276 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.739602 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.739931 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.740282 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.740609 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.740960 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.741273 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.741622 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.741952 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:56:49.742195 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 28 01:56:49.753252 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG oslo_db.sqlalchemy.engines [None req-27fb1d99-2f5e-4302-a159-89f20dc9f088 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101386) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 28 01:56:49.764985 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG oslo_db.sqlalchemy.engines [None req-97a76a5a-f6f5-4487-9ec3-e406d112d5d9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101385) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 28 01:56:49.937486 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.context [None req-27fb1d99-2f5e-4302-a159-89f20dc9f088 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5(cell1) {{(pid=101386) load_cells /opt/stack/nova/nova/context.py:464}} Jan 28 01:56:49.938802 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.context [None req-97a76a5a-f6f5-4487-9ec3-e406d112d5d9 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5(cell1) {{(pid=101385) load_cells /opt/stack/nova/nova/context.py:464}} Jan 28 01:56:49.941696 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG oslo_concurrency.lockutils [None req-27fb1d99-2f5e-4302-a159-89f20dc9f088 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:56:49.943183 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG oslo_concurrency.lockutils [None req-97a76a5a-f6f5-4487-9ec3-e406d112d5d9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:56:49.943318 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG oslo_concurrency.lockutils [None req-27fb1d99-2f5e-4302-a159-89f20dc9f088 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:56:49.944101 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG oslo_concurrency.lockutils [None req-27fb1d99-2f5e-4302-a159-89f20dc9f088 None None] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:56:49.944800 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG oslo_concurrency.lockutils [None req-97a76a5a-f6f5-4487-9ec3-e406d112d5d9 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:56:49.945603 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG oslo_concurrency.lockutils [None req-97a76a5a-f6f5-4487-9ec3-e406d112d5d9 None None] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 01:56:49.946027 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG oslo_concurrency.lockutils [None req-27fb1d99-2f5e-4302-a159-89f20dc9f088 None None] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:56:49.947626 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG oslo_concurrency.lockutils [None req-97a76a5a-f6f5-4487-9ec3-e406d112d5d9 None None] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 01:56:49.956829 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG oslo_db.sqlalchemy.engines [None req-27fb1d99-2f5e-4302-a159-89f20dc9f088 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101386) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 28 01:56:49.959063 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG oslo_db.sqlalchemy.engines [None req-27fb1d99-2f5e-4302-a159-89f20dc9f088 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101386) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 28 01:56:49.960798 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG oslo_db.sqlalchemy.engines [None req-97a76a5a-f6f5-4487-9ec3-e406d112d5d9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101385) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 28 01:56:49.963760 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG oslo_db.sqlalchemy.engines [None req-97a76a5a-f6f5-4487-9ec3-e406d112d5d9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101385) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 28 01:56:50.236471 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG oslo_db.sqlalchemy.engines [None req-97a76a5a-f6f5-4487-9ec3-e406d112d5d9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101385) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 28 01:56:50.240385 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG oslo_db.sqlalchemy.engines [None req-27fb1d99-2f5e-4302-a159-89f20dc9f088 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101386) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 28 01:56:50.717582 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: WARNING keystonemiddleware.auth_token [None req-97a76a5a-f6f5-4487-9ec3-e406d112d5d9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 28 01:56:50.724568 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: WARNING keystonemiddleware.auth_token [None req-97a76a5a-f6f5-4487-9ec3-e406d112d5d9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 28 01:56:50.842278 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: WARNING keystonemiddleware.auth_token [None req-27fb1d99-2f5e-4302-a159-89f20dc9f088 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 28 01:56:50.849103 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: WARNING keystonemiddleware.auth_token [None req-27fb1d99-2f5e-4302-a159-89f20dc9f088 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 28 01:56:51.075949 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: WARNING keystonemiddleware.auth_token [None req-97a76a5a-f6f5-4487-9ec3-e406d112d5d9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 28 01:56:51.081747 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: WARNING keystonemiddleware.auth_token [None req-97a76a5a-f6f5-4487-9ec3-e406d112d5d9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 28 01:56:51.087201 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56028ac269c0 pid: 101385 (default app) Jan 28 01:56:51.089488 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi [None req-97a76a5a-f6f5-4487-9ec3-e406d112d5d9 None None] Calling method '>' {{(pid=101385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:56:51.090683 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: INFO nova.api.openstack.requestlog [None req-97a76a5a-f6f5-4487-9ec3-e406d112d5d9 None None] 10.222.0.79 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001884 Jan 28 01:56:51.091114 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: [pid: 101385|app: 0|req: 1/1] 10.222.0.79 () {50 vars in 788 bytes} [Fri Jan 28 01:56:51 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:56:51.199143 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: WARNING keystonemiddleware.auth_token [None req-27fb1d99-2f5e-4302-a159-89f20dc9f088 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 28 01:56:51.204543 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: WARNING keystonemiddleware.auth_token [None req-27fb1d99-2f5e-4302-a159-89f20dc9f088 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 28 01:56:51.209803 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56028ac269c0 pid: 101386 (default app) Jan 28 01:58:18.580939 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi [None req-97a76a5a-f6f5-4487-9ec3-e406d112d5d9 None None] Calling method '>' {{(pid=101385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:58:18.582947 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: INFO nova.api.openstack.requestlog [None req-97a76a5a-f6f5-4487-9ec3-e406d112d5d9 None None] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Jan 28 01:58:18.582947 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: [pid: 101385|app: 0|req: 2/2] 10.222.0.79 () {54 vars in 930 bytes} [Fri Jan 28 01:58:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 01:58:19.221401 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi [None req-9f3e922c-2d50-4abe-b916-b1bee2836a4f admin admin] Calling method '>' {{(pid=101386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:58:19.255865 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: INFO nova.api.openstack.requestlog [None req-9f3e922c-2d50-4abe-b916-b1bee2836a4f admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.660264 Jan 28 01:58:19.257192 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: [pid: 101386|app: 0|req: 1/3] 10.222.0.79 () {60 vars in 1291 bytes} [Fri Jan 28 01:58:18 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:58:22.032852 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi [None req-97a76a5a-f6f5-4487-9ec3-e406d112d5d9 None None] Calling method '>' {{(pid=101385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:58:22.034365 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: INFO nova.api.openstack.requestlog [None req-97a76a5a-f6f5-4487-9ec3-e406d112d5d9 None None] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001867 Jan 28 01:58:22.034956 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: [pid: 101385|app: 0|req: 3/4] 10.222.0.79 () {54 vars in 930 bytes} [Fri Jan 28 01:58:22 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:58:22.132308 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi [None req-a92f7b9e-ed57-46f4-94bd-9196c2f43b75 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "disk": 1, "id": "c1", "vcpus": 1, "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=101386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:58:22.165441 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:58:22.165441 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: warnings.warn(msg) Jan 28 01:58:22.274737 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: INFO nova.api.openstack.requestlog [None req-a92f7b9e-ed57-46f4-94bd-9196c2f43b75 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.230441 Jan 28 01:58:22.276006 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: [pid: 101386|app: 0|req: 2/5] 10.222.0.79 () {64 vars in 1282 bytes} [Fri Jan 28 01:58:22 2022] POST /compute/v2.1/flavors => generated 407 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 01:58:22.535150 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi [None req-c8996d4f-8b81-4d31-a13f-43ca63dfbe12 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:58:22.538636 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:58:22.538636 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: warnings.warn(msg) Jan 28 01:58:22.687672 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: INFO nova.api.openstack.requestlog [None req-c8996d4f-8b81-4d31-a13f-43ca63dfbe12 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.387532 Jan 28 01:58:22.687672 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: [pid: 101385|app: 0|req: 4/6] 10.222.0.79 () {64 vars in 1335 bytes} [Fri Jan 28 01:58:22 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:58:25.437075 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi [None req-a92f7b9e-ed57-46f4-94bd-9196c2f43b75 admin admin] Calling method '>' {{(pid=101386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:58:25.438083 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: INFO nova.api.openstack.requestlog [None req-a92f7b9e-ed57-46f4-94bd-9196c2f43b75 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Jan 28 01:58:25.438492 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: [pid: 101386|app: 0|req: 3/7] 10.222.0.79 () {54 vars in 930 bytes} [Fri Jan 28 01:58:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:58:25.598755 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi [None req-1a6789ac-7b2a-4c62-bf90-bd7a645f8291 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "name": "ds512M", "disk": 5, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 512, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d1"}} {{(pid=101385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:58:25.624100 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:58:25.624100 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: warnings.warn(msg) Jan 28 01:58:25.722868 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: INFO nova.api.openstack.requestlog [None req-1a6789ac-7b2a-4c62-bf90-bd7a645f8291 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.275585 Jan 28 01:58:25.724319 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: [pid: 101385|app: 0|req: 5/8] 10.222.0.79 () {64 vars in 1282 bytes} [Fri Jan 28 01:58:25 2022] POST /compute/v2.1/flavors => generated 404 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:58:25.740640 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi [None req-dd15e78b-8789-4989-9c80-d12b9b7ec165 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:58:25.742894 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:58:25.742894 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: warnings.warn(msg) Jan 28 01:58:25.875758 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: INFO nova.api.openstack.requestlog [None req-dd15e78b-8789-4989-9c80-d12b9b7ec165 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.139542 Jan 28 01:58:25.876390 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: [pid: 101386|app: 0|req: 4/9] 10.222.0.79 () {64 vars in 1335 bytes} [Fri Jan 28 01:58:25 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:58:28.279051 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi [None req-1a6789ac-7b2a-4c62-bf90-bd7a645f8291 admin admin] Calling method '>' {{(pid=101385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:58:28.280426 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: INFO nova.api.openstack.requestlog [None req-1a6789ac-7b2a-4c62-bf90-bd7a645f8291 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002084 Jan 28 01:58:28.281112 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: [pid: 101385|app: 0|req: 6/10] 10.222.0.79 () {54 vars in 930 bytes} [Fri Jan 28 01:58:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:58:28.385091 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi [None req-39fec65c-1ec5-4a68-9cc5-c786196908b1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "vcpus": 1, "id": "d2", "ram": 1024, "rxtx_factor": 1.0}} {{(pid=101386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:58:28.476139 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: INFO nova.api.openstack.requestlog [None req-39fec65c-1ec5-4a68-9cc5-c786196908b1 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.185976 Jan 28 01:58:28.477196 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: [pid: 101386|app: 0|req: 5/11] 10.222.0.79 () {64 vars in 1282 bytes} [Fri Jan 28 01:58:28 2022] POST /compute/v2.1/flavors => generated 404 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:58:28.490082 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi [None req-0006b50e-977f-4fc8-b0ec-5f7a2ca30811 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:58:28.593952 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: INFO nova.api.openstack.requestlog [None req-0006b50e-977f-4fc8-b0ec-5f7a2ca30811 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.107454 Jan 28 01:58:28.595144 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: [pid: 101385|app: 0|req: 7/12] 10.222.0.79 () {64 vars in 1335 bytes} [Fri Jan 28 01:58:28 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:58:31.335490 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi [None req-39fec65c-1ec5-4a68-9cc5-c786196908b1 admin admin] Calling method '>' {{(pid=101386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:58:31.337270 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: INFO nova.api.openstack.requestlog [None req-39fec65c-1ec5-4a68-9cc5-c786196908b1 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002445 Jan 28 01:58:31.337967 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: [pid: 101386|app: 0|req: 6/13] 10.222.0.79 () {54 vars in 930 bytes} [Fri Jan 28 01:58:31 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:58:31.412251 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi [None req-c65b9075-e9d3-4d36-a0a0-2def9eb5793c admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds2G", "id": "d3", "rxtx_factor": 1.0, "ram": 2048, "swap": 0, "os-flavor-access:is_public": true, "vcpus": 2, "disk": 10}} {{(pid=101385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:58:31.546079 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: INFO nova.api.openstack.requestlog [None req-c65b9075-e9d3-4d36-a0a0-2def9eb5793c admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.200641 Jan 28 01:58:31.546636 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: [pid: 101385|app: 0|req: 8/14] 10.222.0.79 () {64 vars in 1282 bytes} [Fri Jan 28 01:58:31 2022] POST /compute/v2.1/flavors => generated 404 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:58:31.560109 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi [None req-74c9ebdb-56cd-4e60-a65b-b4024fc48bdd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:58:31.709435 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: INFO nova.api.openstack.requestlog [None req-74c9ebdb-56cd-4e60-a65b-b4024fc48bdd admin admin] 10.222.0.79 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.153325 Jan 28 01:58:31.710051 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: [pid: 101386|app: 0|req: 7/15] 10.222.0.79 () {64 vars in 1335 bytes} [Fri Jan 28 01:58:31 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:58:34.132704 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi [None req-c65b9075-e9d3-4d36-a0a0-2def9eb5793c admin admin] Calling method '>' {{(pid=101385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:58:34.134399 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: INFO nova.api.openstack.requestlog [None req-c65b9075-e9d3-4d36-a0a0-2def9eb5793c admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002273 Jan 28 01:58:34.136879 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: [pid: 101385|app: 0|req: 9/16] 10.222.0.79 () {54 vars in 930 bytes} [Fri Jan 28 01:58:34 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:58:34.200275 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi [None req-f66ccd9f-3367-4d36-a923-ec99d96db8cf admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "name": "ds4G", "vcpus": 4, "disk": 20, "ram": 4096}} {{(pid=101386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:58:34.289441 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: INFO nova.api.openstack.requestlog [None req-f66ccd9f-3367-4d36-a923-ec99d96db8cf admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.146486 Jan 28 01:58:34.290703 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: [pid: 101386|app: 0|req: 8/17] 10.222.0.79 () {64 vars in 1282 bytes} [Fri Jan 28 01:58:34 2022] POST /compute/v2.1/flavors => generated 404 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:58:34.312354 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi [None req-bacf71ce-d799-4a6c-80c6-acb23cd529cf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:58:34.407687 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: INFO nova.api.openstack.requestlog [None req-bacf71ce-d799-4a6c-80c6-acb23cd529cf admin admin] 10.222.0.79 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.099066 Jan 28 01:58:34.408879 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: [pid: 101385|app: 0|req: 10/18] 10.222.0.79 () {64 vars in 1335 bytes} [Fri Jan 28 01:58:34 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:58:36.792497 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi [None req-f66ccd9f-3367-4d36-a923-ec99d96db8cf admin admin] Calling method '>' {{(pid=101386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:58:36.793695 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: INFO nova.api.openstack.requestlog [None req-f66ccd9f-3367-4d36-a923-ec99d96db8cf admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001710 Jan 28 01:58:36.794191 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: [pid: 101386|app: 0|req: 9/19] 10.222.0.79 () {54 vars in 930 bytes} [Fri Jan 28 01:58:36 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:58:36.856012 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi [None req-1089f044-e289-424e-8e68-5aee165d3525 admin admin] Calling method '>' {{(pid=101385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:58:36.880807 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: INFO nova.api.openstack.requestlog [None req-1089f044-e289-424e-8e68-5aee165d3525 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.079654 Jan 28 01:58:36.881550 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: [pid: 101385|app: 0|req: 11/20] 10.222.0.79 () {60 vars in 1291 bytes} [Fri Jan 28 01:58:36 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:58:39.485112 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi [None req-f66ccd9f-3367-4d36-a923-ec99d96db8cf admin admin] Calling method '>' {{(pid=101386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:58:39.487294 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: INFO nova.api.openstack.requestlog [None req-f66ccd9f-3367-4d36-a923-ec99d96db8cf admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002543 Jan 28 01:58:39.488229 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: [pid: 101386|app: 0|req: 10/21] 10.222.0.79 () {54 vars in 930 bytes} [Fri Jan 28 01:58:39 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:58:39.561848 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi [None req-84928e8b-1d44-43ae-8449-b72464f8d062 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "ram": 512, "name": "m1.tiny", "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "1", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=101385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:58:39.717917 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: INFO nova.api.openstack.requestlog [None req-84928e8b-1d44-43ae-8449-b72464f8d062 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.222478 Jan 28 01:58:39.718453 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: [pid: 101385|app: 0|req: 12/22] 10.222.0.79 () {64 vars in 1282 bytes} [Fri Jan 28 01:58:39 2022] POST /compute/v2.1/flavors => generated 402 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:58:39.731749 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi [None req-c6dcaca6-1916-4ab0-b615-81eedff9b832 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:58:39.841102 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: INFO nova.api.openstack.requestlog [None req-c6dcaca6-1916-4ab0-b615-81eedff9b832 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.113415 Jan 28 01:58:39.841947 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: [pid: 101386|app: 0|req: 11/23] 10.222.0.79 () {64 vars in 1332 bytes} [Fri Jan 28 01:58:39 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:58:42.247077 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi [None req-84928e8b-1d44-43ae-8449-b72464f8d062 admin admin] Calling method '>' {{(pid=101385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:58:42.248109 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: INFO nova.api.openstack.requestlog [None req-84928e8b-1d44-43ae-8449-b72464f8d062 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Jan 28 01:58:42.248520 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: [pid: 101385|app: 0|req: 13/24] 10.222.0.79 () {54 vars in 930 bytes} [Fri Jan 28 01:58:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:58:42.314864 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi [None req-d2d031e1-3630-4418-9d35-a044d6240de0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "swap": 0, "rxtx_factor": 1.0, "name": "m1.small", "vcpus": 1, "id": "2", "os-flavor-access:is_public": true, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=101386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:58:42.404288 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: INFO nova.api.openstack.requestlog [None req-d2d031e1-3630-4418-9d35-a044d6240de0 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.147542 Jan 28 01:58:42.404948 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: [pid: 101386|app: 0|req: 12/25] 10.222.0.79 () {64 vars in 1282 bytes} [Fri Jan 28 01:58:42 2022] POST /compute/v2.1/flavors => generated 405 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:58:42.420308 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi [None req-7af70c90-ae09-407f-af24-d132d9c8e1d1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:58:42.519714 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: INFO nova.api.openstack.requestlog [None req-7af70c90-ae09-407f-af24-d132d9c8e1d1 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.102909 Jan 28 01:58:42.520627 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: [pid: 101385|app: 0|req: 14/26] 10.222.0.79 () {64 vars in 1332 bytes} [Fri Jan 28 01:58:42 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:58:44.878064 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi [None req-d2d031e1-3630-4418-9d35-a044d6240de0 admin admin] Calling method '>' {{(pid=101386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:58:44.879077 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: INFO nova.api.openstack.requestlog [None req-d2d031e1-3630-4418-9d35-a044d6240de0 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001521 Jan 28 01:58:44.879509 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: [pid: 101386|app: 0|req: 13/27] 10.222.0.79 () {54 vars in 930 bytes} [Fri Jan 28 01:58:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:58:44.953928 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi [None req-1ee7df81-63b1-4971-aa65-98977e84cf76 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "name": "m1.medium", "ram": 4096, "id": "3", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=101385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:58:45.059299 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: INFO nova.api.openstack.requestlog [None req-1ee7df81-63b1-4971-aa65-98977e84cf76 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.172795 Jan 28 01:58:45.059862 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: [pid: 101385|app: 0|req: 15/28] 10.222.0.79 () {64 vars in 1282 bytes} [Fri Jan 28 01:58:44 2022] POST /compute/v2.1/flavors => generated 406 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:58:45.074404 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi [None req-645e8688-566d-4f1c-a987-b8e5ce0742ef admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:58:45.201567 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: INFO nova.api.openstack.requestlog [None req-645e8688-566d-4f1c-a987-b8e5ce0742ef admin admin] 10.222.0.79 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.132348 Jan 28 01:58:45.202352 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: [pid: 101386|app: 0|req: 14/29] 10.222.0.79 () {64 vars in 1332 bytes} [Fri Jan 28 01:58:45 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:58:47.593308 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi [None req-1ee7df81-63b1-4971-aa65-98977e84cf76 admin admin] Calling method '>' {{(pid=101385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:58:47.594441 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: INFO nova.api.openstack.requestlog [None req-1ee7df81-63b1-4971-aa65-98977e84cf76 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002013 Jan 28 01:58:47.594932 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: [pid: 101385|app: 0|req: 16/30] 10.222.0.79 () {54 vars in 930 bytes} [Fri Jan 28 01:58:47 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:58:47.677532 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi [None req-2c87ed9e-54b8-4686-83bb-f11b76bb76db admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "m1.large", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 80, "swap": 0, "vcpus": 4, "id": "4", "ram": 8192}} {{(pid=101386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:58:47.818534 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: INFO nova.api.openstack.requestlog [None req-2c87ed9e-54b8-4686-83bb-f11b76bb76db admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.215772 Jan 28 01:58:47.819561 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: [pid: 101386|app: 0|req: 15/31] 10.222.0.79 () {64 vars in 1282 bytes} [Fri Jan 28 01:58:47 2022] POST /compute/v2.1/flavors => generated 405 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:58:47.832758 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi [None req-6cd4b4d9-0db0-41f8-9fee-0fec2b7c7a9c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:58:47.949495 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: INFO nova.api.openstack.requestlog [None req-6cd4b4d9-0db0-41f8-9fee-0fec2b7c7a9c admin admin] 10.222.0.79 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.120637 Jan 28 01:58:47.950721 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: [pid: 101385|app: 0|req: 17/32] 10.222.0.79 () {64 vars in 1332 bytes} [Fri Jan 28 01:58:47 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:58:50.824134 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi [None req-2c87ed9e-54b8-4686-83bb-f11b76bb76db admin admin] Calling method '>' {{(pid=101386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:58:50.825150 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: INFO nova.api.openstack.requestlog [None req-2c87ed9e-54b8-4686-83bb-f11b76bb76db admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001503 Jan 28 01:58:50.828201 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: [pid: 101386|app: 0|req: 16/33] 10.222.0.79 () {54 vars in 930 bytes} [Fri Jan 28 01:58:50 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 01:58:50.906321 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi [None req-98d5eee4-df37-40f3-aace-ad34e322a050 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "5", "name": "m1.xlarge", "disk": 160, "ram": 16384, "swap": 0, "rxtx_factor": 1.0, "vcpus": 8}} {{(pid=101385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:58:51.532813 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: INFO nova.api.openstack.requestlog [None req-98d5eee4-df37-40f3-aace-ad34e322a050 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.700119 Jan 28 01:58:51.534413 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: [pid: 101385|app: 0|req: 18/34] 10.222.0.79 () {64 vars in 1282 bytes} [Fri Jan 28 01:58:50 2022] POST /compute/v2.1/flavors => generated 408 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 01:58:51.555011 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi [None req-cdd2e32c-4fb6-4306-9c05-1a89bf218c47 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:58:51.680738 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: INFO nova.api.openstack.requestlog [None req-cdd2e32c-4fb6-4306-9c05-1a89bf218c47 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.131478 Jan 28 01:58:51.681748 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: [pid: 101386|app: 0|req: 17/35] 10.222.0.79 () {64 vars in 1332 bytes} [Fri Jan 28 01:58:51 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:59:34.746164 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi [None req-98d5eee4-df37-40f3-aace-ad34e322a050 admin admin] Calling method '>' {{(pid=101385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:34.747206 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: INFO nova.api.openstack.requestlog [None req-98d5eee4-df37-40f3-aace-ad34e322a050 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Jan 28 01:59:34.747906 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: [pid: 101385|app: 0|req: 19/36] 10.222.0.79 () {54 vars in 930 bytes} [Fri Jan 28 01:59:34 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 01:59:34.824419 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi [None req-0f386a3c-89e4-4d88-b724-a424e5237bda admin admin] Calling method '>' {{(pid=101386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:34.852888 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: INFO nova.api.openstack.requestlog [None req-0f386a3c-89e4-4d88-b724-a424e5237bda admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.092240 Jan 28 01:59:34.853454 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: [pid: 101386|app: 0|req: 18/37] 10.222.0.79 () {60 vars in 1291 bytes} [Fri Jan 28 01:59:34 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:59:36.391513 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi [None req-98d5eee4-df37-40f3-aace-ad34e322a050 admin admin] Calling method '>' {{(pid=101385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:36.392550 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: INFO nova.api.openstack.requestlog [None req-98d5eee4-df37-40f3-aace-ad34e322a050 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 Jan 28 01:59:36.392946 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: [pid: 101385|app: 0|req: 20/38] 10.222.0.79 () {56 vars in 1074 bytes} [Fri Jan 28 01:59:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 01:59:36.604388 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi [None req-4a20b341-4772-4f81-8a8b-e7a5dee6cd5c admin admin] Calling method '>' {{(pid=101386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:36.609931 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: INFO nova.api.openstack.wsgi [None req-4a20b341-4772-4f81-8a8b-e7a5dee6cd5c admin admin] HTTP exception thrown: Flavor 42 could not be found. Jan 28 01:59:36.610494 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi [None req-4a20b341-4772-4f81-8a8b-e7a5dee6cd5c admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=101386) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 01:59:36.611295 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: INFO nova.api.openstack.requestlog [None req-4a20b341-4772-4f81-8a8b-e7a5dee6cd5c admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.078111 Jan 28 01:59:36.611805 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: [pid: 101386|app: 0|req: 19/39] 10.222.0.79 () {60 vars in 1190 bytes} [Fri Jan 28 01:59:36 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jan 28 01:59:36.624548 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi [None req-7fe1cabe-f32e-439a-bc98-0aa002c15381 admin admin] Calling method '>' {{(pid=101385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:36.645908 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: INFO nova.api.openstack.requestlog [None req-7fe1cabe-f32e-439a-bc98-0aa002c15381 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024840 Jan 28 01:59:36.646493 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: [pid: 101385|app: 0|req: 21/40] 10.222.0.79 () {60 vars in 1210 bytes} [Fri Jan 28 01:59:36 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 01:59:36.656961 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi [None req-51135f82-7378-4140-b63d-5752e0bca1c6 admin admin] Calling method '>' {{(pid=101386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:36.680074 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: INFO nova.api.openstack.requestlog [None req-51135f82-7378-4140-b63d-5752e0bca1c6 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026491 Jan 28 01:59:36.680646 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: [pid: 101386|app: 0|req: 20/41] 10.222.0.79 () {60 vars in 1210 bytes} [Fri Jan 28 01:59:36 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 01:59:36.691872 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi [None req-1477c59f-2503-4115-b5a6-bb0885db33e5 admin admin] Calling method '>' {{(pid=101385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:36.697661 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: INFO nova.api.openstack.wsgi [None req-1477c59f-2503-4115-b5a6-bb0885db33e5 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jan 28 01:59:36.698260 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi [None req-1477c59f-2503-4115-b5a6-bb0885db33e5 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=101385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 01:59:36.699114 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: INFO nova.api.openstack.requestlog [None req-1477c59f-2503-4115-b5a6-bb0885db33e5 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.011298 Jan 28 01:59:36.699636 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: [pid: 101385|app: 0|req: 22/42] 10.222.0.79 () {60 vars in 1190 bytes} [Fri Jan 28 01:59:36 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jan 28 01:59:38.125486 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi [None req-51135f82-7378-4140-b63d-5752e0bca1c6 admin admin] Calling method '>' {{(pid=101386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:38.126504 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: INFO nova.api.openstack.requestlog [None req-51135f82-7378-4140-b63d-5752e0bca1c6 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Jan 28 01:59:38.126911 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: [pid: 101386|app: 0|req: 21/43] 10.222.0.79 () {56 vars in 1074 bytes} [Fri Jan 28 01:59:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:59:38.326270 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi [None req-fe349046-bc94-4e9c-9de3-d928d129881a admin admin] Calling method '>' {{(pid=101385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:38.332502 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: INFO nova.api.openstack.wsgi [None req-fe349046-bc94-4e9c-9de3-d928d129881a admin admin] HTTP exception thrown: Flavor 84 could not be found. Jan 28 01:59:38.333109 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi [None req-fe349046-bc94-4e9c-9de3-d928d129881a admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=101385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 01:59:38.334048 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: INFO nova.api.openstack.requestlog [None req-fe349046-bc94-4e9c-9de3-d928d129881a admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.064604 Jan 28 01:59:38.334541 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: [pid: 101385|app: 0|req: 23/44] 10.222.0.79 () {60 vars in 1190 bytes} [Fri Jan 28 01:59:38 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 28 01:59:38.344820 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi [None req-7e93609b-b9c8-416e-87ac-2a9d5b153d86 admin admin] Calling method '>' {{(pid=101386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:38.361953 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: INFO nova.api.openstack.requestlog [None req-7e93609b-b9c8-416e-87ac-2a9d5b153d86 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020191 Jan 28 01:59:38.362511 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: [pid: 101386|app: 0|req: 22/45] 10.222.0.79 () {60 vars in 1210 bytes} [Fri Jan 28 01:59:38 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:59:38.376745 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi [None req-bf093edd-dcf7-446d-8100-f8b2a2d9eac1 admin admin] Calling method '>' {{(pid=101385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:38.390406 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: INFO nova.api.openstack.requestlog [None req-bf093edd-dcf7-446d-8100-f8b2a2d9eac1 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017152 Jan 28 01:59:38.390972 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: [pid: 101385|app: 0|req: 24/46] 10.222.0.79 () {60 vars in 1210 bytes} [Fri Jan 28 01:59:38 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 01:59:38.403247 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi [None req-f23309dc-cdad-4ecf-905d-54682779e501 admin admin] Calling method '>' {{(pid=101386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:38.408895 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: INFO nova.api.openstack.wsgi [None req-f23309dc-cdad-4ecf-905d-54682779e501 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jan 28 01:59:38.409461 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi [None req-f23309dc-cdad-4ecf-905d-54682779e501 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=101386) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 01:59:38.410881 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: INFO nova.api.openstack.requestlog [None req-f23309dc-cdad-4ecf-905d-54682779e501 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011061 Jan 28 01:59:38.411403 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: [pid: 101386|app: 0|req: 23/47] 10.222.0.79 () {60 vars in 1190 bytes} [Fri Jan 28 01:59:38 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 28 01:59:39.828454 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi [None req-bf093edd-dcf7-446d-8100-f8b2a2d9eac1 admin admin] Calling method '>' {{(pid=101385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:39.829497 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: INFO nova.api.openstack.requestlog [None req-bf093edd-dcf7-446d-8100-f8b2a2d9eac1 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001503 Jan 28 01:59:39.830100 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: [pid: 101385|app: 0|req: 25/48] 10.222.0.79 () {56 vars in 1074 bytes} [Fri Jan 28 01:59:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:59:40.029918 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi [None req-ecb3eeff-b207-46f0-b010-eac051cc4ac4 admin admin] Calling method '>' {{(pid=101386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:40.036774 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: INFO nova.api.openstack.wsgi [None req-ecb3eeff-b207-46f0-b010-eac051cc4ac4 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jan 28 01:59:40.037352 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi [None req-ecb3eeff-b207-46f0-b010-eac051cc4ac4 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=101386) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 01:59:40.038155 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: INFO nova.api.openstack.requestlog [None req-ecb3eeff-b207-46f0-b010-eac051cc4ac4 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.062678 Jan 28 01:59:40.038704 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: [pid: 101386|app: 0|req: 24/49] 10.222.0.79 () {60 vars in 1193 bytes} [Fri Jan 28 01:59:39 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 28 01:59:40.049047 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi [None req-519c4057-2018-4cee-9de6-3e46e4a5902e admin admin] Calling method '>' {{(pid=101385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:40.063091 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: INFO nova.api.openstack.requestlog [None req-519c4057-2018-4cee-9de6-3e46e4a5902e admin admin] 10.222.0.79 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017635 Jan 28 01:59:40.063641 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: [pid: 101385|app: 0|req: 26/50] 10.222.0.79 () {60 vars in 1210 bytes} [Fri Jan 28 01:59:40 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 01:59:40.075177 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi [None req-7b2ba335-7275-45a2-a039-3d048eea15c1 admin admin] Calling method '>' {{(pid=101386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:40.089565 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: INFO nova.api.openstack.requestlog [None req-7b2ba335-7275-45a2-a039-3d048eea15c1 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017809 Jan 28 01:59:40.090109 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: [pid: 101386|app: 0|req: 25/51] 10.222.0.79 () {60 vars in 1210 bytes} [Fri Jan 28 01:59:40 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:59:40.100642 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi [None req-c7cf1042-b9bf-4920-b694-83af8dff7ec1 admin admin] Calling method '>' {{(pid=101385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:40.105920 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: INFO nova.api.openstack.wsgi [None req-c7cf1042-b9bf-4920-b694-83af8dff7ec1 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jan 28 01:59:40.106472 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi [None req-c7cf1042-b9bf-4920-b694-83af8dff7ec1 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=101385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 01:59:40.107266 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: INFO nova.api.openstack.requestlog [None req-c7cf1042-b9bf-4920-b694-83af8dff7ec1 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.010358 Jan 28 01:59:40.107776 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: [pid: 101385|app: 0|req: 27/52] 10.222.0.79 () {60 vars in 1193 bytes} [Fri Jan 28 01:59:40 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 28 01:59:41.578561 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi [None req-7b2ba335-7275-45a2-a039-3d048eea15c1 admin admin] Calling method '>' {{(pid=101386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:41.579556 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: INFO nova.api.openstack.requestlog [None req-7b2ba335-7275-45a2-a039-3d048eea15c1 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Jan 28 01:59:41.579943 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: [pid: 101386|app: 0|req: 26/53] 10.222.0.79 () {56 vars in 1074 bytes} [Fri Jan 28 01:59:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:59:41.783580 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi [None req-a2b39f75-33a3-4ef9-958d-c70ee23ba920 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:59:42.000144 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: INFO nova.api.openstack.requestlog [None req-a2b39f75-33a3-4ef9-958d-c70ee23ba920 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.272952 Jan 28 01:59:42.000690 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: [pid: 101385|app: 0|req: 28/54] 10.222.0.79 () {64 vars in 1235 bytes} [Fri Jan 28 01:59:41 2022] POST /compute/v2.1/flavors => generated 404 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 01:59:43.453450 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi [None req-7b2ba335-7275-45a2-a039-3d048eea15c1 admin admin] Calling method '>' {{(pid=101386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:43.454510 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: INFO nova.api.openstack.requestlog [None req-7b2ba335-7275-45a2-a039-3d048eea15c1 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001513 Jan 28 01:59:43.454891 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: [pid: 101386|app: 0|req: 27/55] 10.222.0.79 () {56 vars in 1074 bytes} [Fri Jan 28 01:59:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 01:59:43.658942 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi [None req-d6717381-a114-427d-bf73-8e1f2e419c62 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:59:43.782479 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: INFO nova.api.openstack.requestlog [None req-d6717381-a114-427d-bf73-8e1f2e419c62 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.179849 Jan 28 01:59:43.782953 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: [pid: 101385|app: 0|req: 29/56] 10.222.0.79 () {64 vars in 1235 bytes} [Fri Jan 28 01:59:43 2022] POST /compute/v2.1/flavors => generated 405 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 01:59:45.181486 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi [None req-7b2ba335-7275-45a2-a039-3d048eea15c1 admin admin] Calling method '>' {{(pid=101386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:45.182456 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: INFO nova.api.openstack.requestlog [None req-7b2ba335-7275-45a2-a039-3d048eea15c1 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001412 Jan 28 01:59:45.182839 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: [pid: 101386|app: 0|req: 28/57] 10.222.0.79 () {56 vars in 1074 bytes} [Fri Jan 28 01:59:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:59:45.387911 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi [None req-e6d484e6-42dd-4ee7-838b-e23143dd987c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:59:45.479411 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: INFO nova.api.openstack.requestlog [None req-e6d484e6-42dd-4ee7-838b-e23143dd987c admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.146048 Jan 28 01:59:45.479947 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: [pid: 101385|app: 0|req: 30/58] 10.222.0.79 () {64 vars in 1235 bytes} [Fri Jan 28 01:59:45 2022] POST /compute/v2.1/flavors => generated 407 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 01:59:46.875793 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi [None req-7b2ba335-7275-45a2-a039-3d048eea15c1 admin admin] Calling method '>' {{(pid=101386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:46.876821 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: INFO nova.api.openstack.requestlog [None req-7b2ba335-7275-45a2-a039-3d048eea15c1 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Jan 28 01:59:46.877208 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: [pid: 101386|app: 0|req: 29/59] 10.222.0.79 () {56 vars in 1074 bytes} [Fri Jan 28 01:59:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:59:47.083181 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi [None req-7820dcc1-4e7f-43c4-bfd0-7ce36f772b47 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:59:47.193982 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: INFO nova.api.openstack.requestlog [None req-7820dcc1-4e7f-43c4-bfd0-7ce36f772b47 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.170249 Jan 28 01:59:47.194535 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: [pid: 101385|app: 0|req: 31/60] 10.222.0.79 () {64 vars in 1235 bytes} [Fri Jan 28 01:59:47 2022] POST /compute/v2.1/flavors => generated 409 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:59:48.648219 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi [None req-7b2ba335-7275-45a2-a039-3d048eea15c1 admin admin] Calling method '>' {{(pid=101386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:48.648219 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: INFO nova.api.openstack.requestlog [None req-7b2ba335-7275-45a2-a039-3d048eea15c1 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Jan 28 01:59:48.648219 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: [pid: 101386|app: 0|req: 30/61] 10.222.0.79 () {56 vars in 1074 bytes} [Fri Jan 28 01:59:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:59:48.849996 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi [None req-1f8c54c1-3478-4b03-9581-de39ac850ab9 admin admin] Calling method '>' {{(pid=101385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:59:48.869417 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: INFO nova.api.openstack.requestlog [None req-1f8c54c1-3478-4b03-9581-de39ac850ab9 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.079764 Jan 28 01:59:48.869947 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: [pid: 101385|app: 0|req: 32/62] 10.222.0.79 () {60 vars in 1202 bytes} [Fri Jan 28 01:59:48 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:00:31.506201 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi [None req-7b2ba335-7275-45a2-a039-3d048eea15c1 admin admin] Calling method '>' {{(pid=101386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:00:31.507193 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: INFO nova.api.openstack.requestlog [None req-7b2ba335-7275-45a2-a039-3d048eea15c1 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001404 Jan 28 02:00:31.507582 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: [pid: 101386|app: 0|req: 31/63] 10.222.0.79 () {54 vars in 930 bytes} [Fri Jan 28 02:00:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:00:31.566817 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi [None req-afd02236-3543-4153-a791-9176015fa6b9 admin admin] Calling method '>' {{(pid=101385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:00:31.585330 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: INFO nova.api.openstack.requestlog [None req-afd02236-3543-4153-a791-9176015fa6b9 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.070902 Jan 28 02:00:31.585854 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: [pid: 101385|app: 0|req: 33/64] 10.222.0.79 () {60 vars in 1291 bytes} [Fri Jan 28 02:00:31 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 02:00:31.608587 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi [None req-0c072925-c7d2-444c-b1da-93ebf4df1a2b admin admin] Calling method '>' {{(pid=101386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:00:31.616913 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: INFO nova.api.openstack.requestlog [None req-0c072925-c7d2-444c-b1da-93ebf4df1a2b admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012027 Jan 28 02:00:31.617420 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: [pid: 101386|app: 0|req: 32/65] 10.222.0.79 () {60 vars in 1282 bytes} [Fri Jan 28 02:00:31 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:00:31.629594 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi [None req-91d1d41c-f387-4d0f-8943-7a725729e75b admin admin] Calling method '>' {{(pid=101385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:00:31.637308 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: INFO nova.api.openstack.requestlog [None req-91d1d41c-f387-4d0f-8943-7a725729e75b admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011789 Jan 28 02:00:31.637814 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: [pid: 101385|app: 0|req: 34/66] 10.222.0.79 () {60 vars in 1285 bytes} [Fri Jan 28 02:00:31 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:00:31.649437 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi [None req-185c92aa-cee2-4701-a3a8-f79867e84017 admin admin] Calling method '>' {{(pid=101386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:00:31.657475 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: INFO nova.api.openstack.requestlog [None req-185c92aa-cee2-4701-a3a8-f79867e84017 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011317 Jan 28 02:00:31.658001 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: [pid: 101386|app: 0|req: 33/67] 10.222.0.79 () {60 vars in 1285 bytes} [Fri Jan 28 02:00:31 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:00:31.670098 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi [None req-6b3b92d9-faa6-4016-b602-4344e7e2fbe6 admin admin] Calling method '>' {{(pid=101385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:00:31.678504 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: INFO nova.api.openstack.requestlog [None req-6b3b92d9-faa6-4016-b602-4344e7e2fbe6 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011944 Jan 28 02:00:31.679010 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: [pid: 101385|app: 0|req: 35/68] 10.222.0.79 () {60 vars in 1282 bytes} [Fri Jan 28 02:00:31 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:02:09.857962 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi [None req-efd87505-fc89-4bf1-8511-259ddad4f0a9 tempest-verify_tempest_config-469071127 tempest-verify_tempest_config-469071127-project] Calling method '>' {{(pid=101386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:02:09.859887 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: INFO nova.api.openstack.requestlog [None req-efd87505-fc89-4bf1-8511-259ddad4f0a9 tempest-verify_tempest_config-469071127 tempest-verify_tempest_config-469071127-project] 10.222.0.79 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.108925 Jan 28 02:02:09.860445 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: [pid: 101386|app: 0|req: 34/69] 10.222.0.79 () {58 vars in 1133 bytes} [Fri Jan 28 02:02:09 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 02:03:46.749384 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi [None req-6b3b92d9-faa6-4016-b602-4344e7e2fbe6 admin admin] Calling method '>' {{(pid=101385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:46.750405 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: INFO nova.api.openstack.requestlog [None req-6b3b92d9-faa6-4016-b602-4344e7e2fbe6 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Jan 28 02:03:46.750790 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: [pid: 101385|app: 0|req: 36/70] 10.222.0.79 () {56 vars in 1074 bytes} [Fri Jan 28 02:03:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:03:47.012040 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi [None req-8babb0f3-2cb1-45dd-858b-0705ff9e08be admin admin] Calling method '>' {{(pid=101386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:47.013192 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:03:47.013192 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: warnings.warn(msg) Jan 28 02:03:47.014711 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG oslo_concurrency.lockutils [None req-8babb0f3-2cb1-45dd-858b-0705ff9e08be admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:47.015154 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG oslo_concurrency.lockutils [None req-8babb0f3-2cb1-45dd-858b-0705ff9e08be admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:47.016035 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG oslo_concurrency.lockutils [None req-8babb0f3-2cb1-45dd-858b-0705ff9e08be admin admin] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:47.016469 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG oslo_concurrency.lockutils [None req-8babb0f3-2cb1-45dd-858b-0705ff9e08be admin admin] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:47.049482 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: INFO nova.api.openstack.requestlog [None req-8babb0f3-2cb1-45dd-858b-0705ff9e08be admin admin] 10.222.0.79 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.149789 Jan 28 02:03:47.050042 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: [pid: 101386|app: 0|req: 35/71] 10.222.0.79 () {60 vars in 1193 bytes} [Fri Jan 28 02:03:46 2022] GET /compute/v2.1/os-services => generated 791 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 02:03:48.459855 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi [None req-6b3b92d9-faa6-4016-b602-4344e7e2fbe6 admin admin] Calling method '>' {{(pid=101385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:48.460921 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: INFO nova.api.openstack.requestlog [None req-6b3b92d9-faa6-4016-b602-4344e7e2fbe6 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Jan 28 02:03:48.461312 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: [pid: 101385|app: 0|req: 37/72] 10.222.0.79 () {56 vars in 1074 bytes} [Fri Jan 28 02:03:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:03:48.667475 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi [None req-ba9b92fa-16b6-49a7-ab5a-582feefb2e09 admin admin] Calling method '>' {{(pid=101386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:03:48.668616 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:03:48.668616 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: warnings.warn(msg) Jan 28 02:03:48.670178 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG oslo_concurrency.lockutils [None req-ba9b92fa-16b6-49a7-ab5a-582feefb2e09 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:48.670615 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG oslo_concurrency.lockutils [None req-ba9b92fa-16b6-49a7-ab5a-582feefb2e09 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:48.671384 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG oslo_concurrency.lockutils [None req-ba9b92fa-16b6-49a7-ab5a-582feefb2e09 admin admin] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:03:48.671801 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG oslo_concurrency.lockutils [None req-ba9b92fa-16b6-49a7-ab5a-582feefb2e09 admin admin] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:03:48.691079 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: INFO nova.api.openstack.requestlog [None req-ba9b92fa-16b6-49a7-ab5a-582feefb2e09 admin admin] 10.222.0.79 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.083631 Jan 28 02:03:48.691657 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: [pid: 101386|app: 0|req: 36/73] 10.222.0.79 () {60 vars in 1193 bytes} [Fri Jan 28 02:03:48 2022] GET /compute/v2.1/os-services => generated 791 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 02:04:00.792974 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi [None req-6b3b92d9-faa6-4016-b602-4344e7e2fbe6 admin admin] Calling method '>' {{(pid=101385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:00.794097 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: INFO nova.api.openstack.requestlog [None req-6b3b92d9-faa6-4016-b602-4344e7e2fbe6 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001558 Jan 28 02:04:00.794480 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: [pid: 101385|app: 0|req: 38/74] 10.222.0.79 () {56 vars in 1074 bytes} [Fri Jan 28 02:04:00 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:04:00.992226 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi [None req-dafeac01-a441-4a0b-8512-6b66b897a2cd admin admin] Calling method '>' {{(pid=101386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:00.993440 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:04:00.993440 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: warnings.warn(msg) Jan 28 02:04:00.994936 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG oslo_concurrency.lockutils [None req-dafeac01-a441-4a0b-8512-6b66b897a2cd admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:00.995374 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG oslo_concurrency.lockutils [None req-dafeac01-a441-4a0b-8512-6b66b897a2cd admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:00.996214 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG oslo_concurrency.lockutils [None req-dafeac01-a441-4a0b-8512-6b66b897a2cd admin admin] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:00.996784 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG oslo_concurrency.lockutils [None req-dafeac01-a441-4a0b-8512-6b66b897a2cd admin admin] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:01.022212 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: INFO nova.api.openstack.requestlog [None req-dafeac01-a441-4a0b-8512-6b66b897a2cd admin admin] 10.222.0.79 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.086897 Jan 28 02:04:01.022688 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: [pid: 101386|app: 0|req: 37/75] 10.222.0.79 () {60 vars in 1193 bytes} [Fri Jan 28 02:04:00 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:04:02.433173 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: DEBUG nova.api.openstack.wsgi [None req-6b3b92d9-faa6-4016-b602-4344e7e2fbe6 admin admin] Calling method '>' {{(pid=101385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:02.434172 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: INFO nova.api.openstack.requestlog [None req-6b3b92d9-faa6-4016-b602-4344e7e2fbe6 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001417 Jan 28 02:04:02.434572 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: [pid: 101385|app: 0|req: 39/76] 10.222.0.79 () {56 vars in 1074 bytes} [Fri Jan 28 02:04:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:04:02.637147 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG nova.api.openstack.wsgi [None req-91a543b5-6808-4356-accb-1e9f826f47fb admin admin] Calling method '>' {{(pid=101386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:04:02.643003 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:04:02.643003 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: warnings.warn(msg) Jan 28 02:04:02.643003 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG oslo_concurrency.lockutils [None req-91a543b5-6808-4356-accb-1e9f826f47fb admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:02.643003 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG oslo_concurrency.lockutils [None req-91a543b5-6808-4356-accb-1e9f826f47fb admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:02.643003 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG oslo_concurrency.lockutils [None req-91a543b5-6808-4356-accb-1e9f826f47fb admin admin] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:04:02.643003 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: DEBUG oslo_concurrency.lockutils [None req-91a543b5-6808-4356-accb-1e9f826f47fb admin admin] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:04:02.663845 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: INFO nova.api.openstack.requestlog [None req-91a543b5-6808-4356-accb-1e9f826f47fb admin admin] 10.222.0.79 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.081429 Jan 28 02:04:02.664434 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: [pid: 101386|app: 0|req: 38/77] 10.222.0.79 () {60 vars in 1193 bytes} [Fri Jan 28 02:04:02 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:05:03.292584 dv-cinder-824977-1-iscsi devstack@n-api.service[101384]: Fri Jan 28 02:05:03 2022 - graceful shutdown triggered... Jan 28 02:05:03.292076 dv-cinder-824977-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jan 28 02:05:03.293522 dv-cinder-824977-1-iscsi devstack@n-api.service[101386]: Gracefully killing worker 2 (pid: 101386)... Jan 28 02:05:03.293872 dv-cinder-824977-1-iscsi devstack@n-api.service[101385]: Gracefully killing worker 1 (pid: 101385)... Jan 28 02:05:04.293530 dv-cinder-824977-1-iscsi devstack@n-api.service[101384]: worker 1 buried after 1 seconds Jan 28 02:05:04.294033 dv-cinder-824977-1-iscsi devstack@n-api.service[101384]: worker 2 buried after 1 seconds Jan 28 02:05:04.294033 dv-cinder-824977-1-iscsi devstack@n-api.service[101384]: goodbye to uWSGI. Jan 28 02:05:04.295144 dv-cinder-824977-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jan 28 02:05:04.295725 dv-cinder-824977-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jan 28 02:05:04.298557 dv-cinder-824977-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jan 28 02:05:04.308532 dv-cinder-824977-1-iscsi devstack@n-api.service[116358]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jan 28 02:05:04.310473 dv-cinder-824977-1-iscsi devstack@n-api.service[116358]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jan 28 02:05:04 2022] *** Jan 28 02:05:04.310473 dv-cinder-824977-1-iscsi devstack@n-api.service[116358]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jan 28 02:05:04.310473 dv-cinder-824977-1-iscsi devstack@n-api.service[116358]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jan 28 02:05:04.310473 dv-cinder-824977-1-iscsi devstack@n-api.service[116358]: nodename: dv-cinder-824977-1-iscsi Jan 28 02:05:04.310473 dv-cinder-824977-1-iscsi devstack@n-api.service[116358]: machine: x86_64 Jan 28 02:05:04.310473 dv-cinder-824977-1-iscsi devstack@n-api.service[116358]: clock source: unix Jan 28 02:05:04.310473 dv-cinder-824977-1-iscsi devstack@n-api.service[116358]: pcre jit disabled Jan 28 02:05:04.310473 dv-cinder-824977-1-iscsi devstack@n-api.service[116358]: detected number of CPU cores: 4 Jan 28 02:05:04.310473 dv-cinder-824977-1-iscsi devstack@n-api.service[116358]: current working directory: / Jan 28 02:05:04.310473 dv-cinder-824977-1-iscsi devstack@n-api.service[116358]: detected binary path: /usr/bin/uwsgi-core Jan 28 02:05:04.310473 dv-cinder-824977-1-iscsi devstack@n-api.service[116358]: your processes number limit is 47680 Jan 28 02:05:04.310473 dv-cinder-824977-1-iscsi devstack@n-api.service[116358]: your memory page size is 4096 bytes Jan 28 02:05:04.310473 dv-cinder-824977-1-iscsi devstack@n-api.service[116358]: detected max file descriptor number: 2048 Jan 28 02:05:04.310473 dv-cinder-824977-1-iscsi devstack@n-api.service[116358]: lock engine: pthread robust mutexes Jan 28 02:05:04.311582 dv-cinder-824977-1-iscsi devstack@n-api.service[116358]: thunder lock: enabled Jan 28 02:05:04.311582 dv-cinder-824977-1-iscsi devstack@n-api.service[116358]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jan 28 02:05:04.311582 dv-cinder-824977-1-iscsi devstack@n-api.service[116358]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Jan 28 02:05:04.356545 dv-cinder-824977-1-iscsi devstack@n-api.service[116358]: Python main interpreter initialized at 0x561dcb5759c0 Jan 28 02:05:04.356545 dv-cinder-824977-1-iscsi devstack@n-api.service[116358]: python threads support enabled Jan 28 02:05:04.356545 dv-cinder-824977-1-iscsi devstack@n-api.service[116358]: your server socket listen backlog is limited to 100 connections Jan 28 02:05:04.356545 dv-cinder-824977-1-iscsi devstack@n-api.service[116358]: your mercy for graceful operations on workers is 90 seconds Jan 28 02:05:04.357089 dv-cinder-824977-1-iscsi devstack@n-api.service[116358]: mapped 403077 bytes (393 KB) for 2 cores Jan 28 02:05:04.357089 dv-cinder-824977-1-iscsi devstack@n-api.service[116358]: *** Operational MODE: preforking *** Jan 28 02:05:04.357333 dv-cinder-824977-1-iscsi devstack@n-api.service[116358]: *** uWSGI is running in multiple interpreter mode *** Jan 28 02:05:04.357333 dv-cinder-824977-1-iscsi devstack@n-api.service[116358]: spawned uWSGI master process (pid: 116358) Jan 28 02:05:04.357422 dv-cinder-824977-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jan 28 02:05:04.358158 dv-cinder-824977-1-iscsi devstack@n-api.service[116358]: spawned uWSGI worker 1 (pid: 116374, cores: 1) Jan 28 02:05:04.358668 dv-cinder-824977-1-iscsi devstack@n-api.service[116358]: spawned uWSGI worker 2 (pid: 116375, cores: 1) Jan 28 02:05:04.358967 dv-cinder-824977-1-iscsi devstack@n-api.service[116358]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jan 28 02:05:06.212525 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 28 02:05:06.212525 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: from cryptography.utils import int_from_bytes Jan 28 02:05:06.213224 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 28 02:05:06.213224 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: from cryptography.utils import int_from_bytes Jan 28 02:05:06.217683 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 28 02:05:06.217683 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: from cryptography.utils import int_from_bytes Jan 28 02:05:06.218195 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 28 02:05:06.218195 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: from cryptography.utils import int_from_bytes Jan 28 02:05:08.899151 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 28 02:05:08.899759 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 28 02:05:08.899891 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 28 02:05:08.900285 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 28 02:05:08.900540 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 28 02:05:08.900931 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:08.901257 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:08.901580 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:08.901897 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:08.902226 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:08.902538 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:08.902859 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:08.903178 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:08.903572 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:08.903831 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:08.904294 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:08.904550 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-824977-1-iscsi {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:08.904867 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:08.905178 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:08.905488 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:08.905815 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:08.906120 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:08.906441 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:08.906747 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:08.907252 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:08.911592 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:08.911592 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:08.911592 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:08.911592 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:08.911592 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:08.911592 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:08.911592 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:08.911592 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:08.912604 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:08.912604 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:08.912604 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-824977-1-iscsi {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:08.912604 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:08.912604 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:08.912604 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:08.913269 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:08.913589 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:08.913906 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:08.914235 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:08.915396 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:08.915892 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:08.916431 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:08.916902 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:08.917402 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:08.917731 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:08.918044 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:08.918363 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:08.918681 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:08.919004 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:08.919316 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:08.919635 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:08.919888 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:08.920422 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:08.920758 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:08.921083 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:08.921423 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:08.921661 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:08.921911 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:08.922230 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:08.922552 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:08.922863 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:08.923174 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:08.924165 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:08.924578 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:08.924892 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:08.925205 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:08.925514 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:08.925824 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:08.926151 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:08.926468 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:08.926793 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:08.927103 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:08.927424 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:08.927836 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.79 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:08.928113 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.79 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:08.928423 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:08.928770 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:08.929092 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:08.929401 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:08.929720 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:08.930042 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:08.930351 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:08.930664 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:08.930971 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:08.931293 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:08.931616 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:08.931923 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:08.932206 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:08.932510 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:08.932817 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:08.933135 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:08.933441 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:08.933747 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:08.934054 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:08.934357 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:08.934666 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:08.934976 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:08.935307 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:08.935595 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:08.935902 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:08.936237 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:08.936543 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:08.936852 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:08.937160 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:08.937486 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:08.937806 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:08.938114 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:08.938420 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:08.938724 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:08.939170 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:08.939685 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:08.940216 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:08.940533 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:08.940866 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:08.941179 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:08.941492 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:08.941813 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:08.942122 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:08.942433 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:08.942754 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:08.943057 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:08.943364 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:08.943683 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:08.944009 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:08.944322 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:08.944627 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:08.944937 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:08.945242 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:08.945548 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:08.945857 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:08.946168 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:08.946468 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:08.946790 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:08.947112 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:08.947424 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:08.947731 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:08.948063 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:08.948386 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:08.948729 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:08.949063 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:08.949409 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:08.949726 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:08.950061 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:08.950394 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:08.950823 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:08.951027 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:08.951345 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:08.951672 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:08.952073 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:08.952323 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:08.952639 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:08.952958 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:08.953277 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:08.953606 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:08.953926 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:08.954246 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:08.955131 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:08.955654 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:08.956076 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:08.956409 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:08.956740 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:08.957055 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:08.957406 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:08.957752 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:08.958066 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:08.958390 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:08.958704 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:08.959030 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:08.959344 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:08.959658 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:08.959993 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:08.960323 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:08.960635 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:08.960950 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:08.961292 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:08.961613 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:08.961931 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:08.962240 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:08.962546 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:08.962852 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:08.963164 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:08.963470 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:08.964079 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:08.964408 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:08.964716 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:08.965054 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:08.965361 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:08.965678 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:08.965994 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:08.966301 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:08.966611 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:08.966925 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:08.967231 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:08.967550 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:08.967861 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:08.968197 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:08.968521 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:08.968826 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:08.969131 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:08.969447 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:08.969759 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:08.970071 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:08.971081 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:08.971520 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:08.971890 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:08.972180 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:08.972517 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:08.972853 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:08.973161 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:08.973488 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:08.973815 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:08.974134 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:08.974439 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:08.974750 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:08.975055 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:08.975359 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:08.975663 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:08.975996 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:08.976312 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:08.976616 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:08.976920 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:08.977227 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:08.977532 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:08.977854 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:08.978166 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:08.978474 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:08.978780 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:08.979085 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:08.979431 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:08.979741 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:08.980107 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:08.980447 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:08.980769 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:08.981092 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:08.981407 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:08.981730 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:08.982247 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:08.982453 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:08.982768 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:08.983082 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:08.983406 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:08.983719 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:08.984110 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:08.984386 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:08.984713 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:08.985027 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:08.985350 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:08.985657 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:08.986149 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:08.986373 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:08.986796 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:08.987118 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:08.987443 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:08.987757 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:08.988101 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:08.988420 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:08.988735 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:08.989049 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:08.989361 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:08.989682 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:08.989994 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:08.990313 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:08.990629 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:08.990954 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:08.991265 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:08.991585 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:08.991888 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:08.992228 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:08.992558 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:08.992890 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:08.993203 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:08.993517 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:08.993840 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:08.994153 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:08.994464 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:08.994777 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:08.995086 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:08.995396 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:08.995709 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:08.996053 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:08.996371 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:08.996681 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:08.996988 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:08.997307 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:08.997621 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:08.998042 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:08.998229 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:08.998528 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 28 02:05:08.998966 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:08.999061 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 28 02:05:08.999146 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:08.999146 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:08.999312 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 28 02:05:08.999456 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:08.999595 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 28 02:05:08.999775 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:08.999867 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 28 02:05:09.000119 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.000297 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:09.000411 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.000579 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:09.000733 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.000907 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:09.001044 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.001232 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:09.001337 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.001644 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:09.001855 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.002171 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:09.002270 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.002545 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.002652 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:09.002862 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.002967 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:09.003170 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.003263 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:09.003490 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.003582 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:09.003815 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.003916 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:09.004156 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.004251 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-824977-1-iscsi {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:09.004477 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.004570 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:09.004789 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:09.004880 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.005100 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.005198 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:09.005422 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:09.005519 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.005731 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:09.005825 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.006046 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.006143 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:09.006360 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:09.006492 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.006671 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.006868 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:09.006977 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.007186 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:09.007311 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.007496 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:09.007597 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.007809 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:09.007912 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.008178 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:09.008294 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.008500 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:09.008591 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.008803 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.008894 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:09.009112 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.009291 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:09.009429 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:09.009520 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.009756 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:09.010002 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.010094 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:09.010337 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.010460 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-824977-1-iscsi {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:09.010653 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.010782 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:09.010976 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.011099 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:09.011297 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.011419 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:09.011617 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.011950 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.012083 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:09.012298 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.012399 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:09.012613 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.012705 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:09.012921 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.013024 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:09.013234 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.013327 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:09.013541 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.013634 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:09.013847 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.013952 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:09.014161 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.014254 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:09.014467 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.014567 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:09.014771 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.014877 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:09.015075 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.015176 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:09.015386 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.015485 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:09.015690 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.015782 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:09.016169 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.016280 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:09.016379 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:09.016492 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.016697 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:09.016809 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.016895 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:09.016991 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.017767 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.017883 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:09.018077 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.018346 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:09.018496 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.018686 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:09.018822 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.019018 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:09.019119 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.019276 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:09.019428 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.019531 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:09.019735 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.019828 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:09.020065 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.020174 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:09.020411 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.020506 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:09.020715 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.020808 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:09.021054 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.021158 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:09.021372 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:09.021472 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.021684 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:09.021776 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.021997 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:09.022101 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.022295 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.022395 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:09.022607 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:09.022698 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.022910 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.023001 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:09.023215 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.023308 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:09.023518 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.023618 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:09.023831 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.023932 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:09.024169 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.024263 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:09.024475 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.024578 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.79 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:09.024785 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.024893 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.79 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:09.025095 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.025188 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:09.025405 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.025498 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:09.025715 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.025818 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:09.026018 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.026115 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:09.026328 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.026429 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:09.026637 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.026755 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:09.026952 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:09.027054 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.027256 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.027356 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:09.027559 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.027653 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:09.027860 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.027954 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:09.028202 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.028297 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:09.028513 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.028615 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:09.028764 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:09.028862 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.029068 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:09.029160 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.029378 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:09.029479 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.029701 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:09.029803 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.030007 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.030139 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:09.030311 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.030418 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:09.030616 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.030710 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:09.030918 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:09.031033 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.031227 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.031327 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:09.031529 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.031621 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:09.031840 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:09.031945 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.032177 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.032309 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:09.032479 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.032573 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:09.032848 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:09.032996 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.033388 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:09.033507 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.033704 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.033835 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:09.034024 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.034154 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:09.034351 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.034480 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:09.034671 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.034807 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:09.034980 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.035122 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:09.035296 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.035437 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:09.035605 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.035749 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:09.035909 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.036087 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:09.036251 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.036414 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:09.036548 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.036726 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:09.036852 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.037037 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:09.037145 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.037361 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:09.037464 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.037677 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:09.037770 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.037989 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:09.038088 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.038312 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:09.038405 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.038622 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:09.038713 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.038924 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.039025 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:09.039230 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.039331 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:09.039538 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.039638 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:09.039850 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:09.039954 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.040199 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:09.040305 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.040511 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:09.040603 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.040825 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:09.040919 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.041133 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:09.041233 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.041443 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:09.041542 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.041749 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:09.041842 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.042057 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.042148 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:09.042367 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:09.042479 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.042670 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.042781 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:09.042975 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:09.043076 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.043283 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.043381 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:09.043593 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.043694 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:09.043897 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.044035 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:09.044227 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.044339 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:09.044535 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:09.044626 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.044847 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.044937 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 02:05:09.045160 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.045276 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.045483 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.045577 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.045806 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.045902 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.046131 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.046236 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.046445 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.046556 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.046772 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.046861 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.047081 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.047201 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.047487 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.047580 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.047714 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.047807 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.048073 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.048198 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.048924 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.049521 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.049663 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.049858 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.049966 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.050187 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.050277 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.050514 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.050602 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.050849 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.050949 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.051162 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.051258 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.051481 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.051579 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.051798 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.051898 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.052138 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.052230 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.052468 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.052666 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.052767 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.052860 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.053078 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.053188 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.053395 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.053496 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.053706 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.053806 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.054039 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.054148 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.054328 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.054436 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.054708 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.054814 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.055028 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.055127 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.055358 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.055464 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.055666 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.055771 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.055992 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.056089 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.056319 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.056435 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.056637 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.056752 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.056954 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.057058 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.057261 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.057366 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.057602 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.057716 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.057924 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.058018 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.058248 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.058360 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.058556 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.058656 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.058867 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.058966 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.059171 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.059271 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.059484 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.059585 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.059791 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.059889 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.060127 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.060245 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.060436 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.060546 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.060739 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.060839 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.061061 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.061154 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.061366 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.061457 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.061684 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.061774 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.062000 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.062100 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.062311 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.062419 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.062632 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.062730 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.062948 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.063118 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.063257 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.063394 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.063581 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.063750 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.064037 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.064681 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.064967 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.065067 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.065330 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.065440 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.065638 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.065741 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.065955 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.066054 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.066271 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.066409 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.066659 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.066786 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.066924 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.067052 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.067244 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.067378 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.067565 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.067667 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.067876 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.068008 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.068217 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.068323 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.068545 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.068648 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.068859 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.068952 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.069183 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.069275 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.069514 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.069606 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.069845 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.069944 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.070168 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.070271 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.070484 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.070621 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.070803 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.070965 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.071122 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.071265 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.071436 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.071522 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.071694 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.071843 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.072022 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.072126 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.072337 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.072436 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.072653 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.072830 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.072995 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.073142 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.073282 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.073427 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.073566 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.073712 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.073862 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.074001 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.074171 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.074389 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.074529 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.074676 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.074815 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.074964 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.075103 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.075250 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.075400 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.075546 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.075774 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.075914 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.076216 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.076321 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.076600 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.076718 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.076918 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.077020 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.077255 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.077358 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.077574 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.077690 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.077971 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.078086 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.078180 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.078265 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.078491 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.078599 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.078820 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.078922 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.079135 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.079240 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.079460 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.079771 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.079955 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.080071 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.080167 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.080436 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.080529 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.080764 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.080864 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.081101 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.081193 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.081423 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.081515 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.081742 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.081848 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.082054 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.082143 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.082365 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.082456 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.082675 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.082775 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.082991 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.083091 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.083298 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.083413 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.083607 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.083698 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.083913 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.084053 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.084252 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.084351 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.084558 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.084649 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.084866 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.084970 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.085172 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.085264 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.085497 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.085594 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.085803 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.085903 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.086128 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.086218 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.086442 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.086541 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.086751 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.086850 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.087066 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.087158 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.087373 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.087472 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.087695 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.087785 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.088027 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.088165 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.088350 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.088453 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.088928 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.089029 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.089252 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.089350 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.089569 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.089665 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.089884 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.089974 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.090207 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.090298 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.090525 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.090613 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.090842 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.090943 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.091155 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.091243 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.091467 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.091571 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.091781 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.091871 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.092116 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.092208 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.092436 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.092544 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.092748 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.092856 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.093064 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.093156 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.093377 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.093475 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.093695 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.093792 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.094008 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.094234 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.094324 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.094593 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.094696 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.094881 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.095031 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.095240 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.095390 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.095561 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.095868 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.096016 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.096208 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.096301 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.096524 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.096619 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.096839 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.096933 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.097161 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.097264 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.097475 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.097575 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.097797 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.097887 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.098109 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.098214 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.098423 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.098524 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.098735 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.098827 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.099064 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.099181 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.099379 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.099472 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.099687 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.099784 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.100031 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.100199 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.100336 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.100482 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.100655 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.100755 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.100976 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.101115 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.101289 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.101429 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.101602 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.101741 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.102012 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.102104 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.102230 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.102324 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.102542 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.102632 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.102860 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.102952 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.103177 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.103268 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.103491 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.103586 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.103807 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.103905 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.104160 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.104252 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.104480 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.107675 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.107828 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.108067 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.108175 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.108275 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.108356 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.108451 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.108535 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.108623 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.108705 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.108784 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.108784 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.108951 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.109034 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.109114 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.109197 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.109268 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.109268 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.109435 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.109524 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.109613 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.109695 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.109775 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.109868 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.109962 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.110044 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.110129 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.110210 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.110297 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.110387 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.110475 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.110556 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.110644 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.110725 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.111299 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.111389 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.111468 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.111546 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.111616 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.111703 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.111793 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.111986 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.112148 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.112293 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.112472 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.112617 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.112800 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.112930 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.113116 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.113431 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.113527 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.113752 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.113855 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.114065 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.114155 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.114388 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.114479 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.114700 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.114791 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.115020 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.115120 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.115327 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.115424 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.115652 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.115741 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.115960 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.116126 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.116293 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.116393 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.116602 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.116704 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.116914 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.117013 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.117264 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.117374 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.117573 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.117671 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.117909 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.118012 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.118222 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.118313 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.118530 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.118629 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.118844 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.118937 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.119164 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.119259 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.119494 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.119597 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.119804 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.119904 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.120135 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.120227 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.120445 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.120553 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.120763 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.120854 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.121128 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.121224 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.121382 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.121481 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.121691 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.121784 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.121998 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.122098 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.122317 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.122472 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.122630 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.122767 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.122939 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.123032 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.123254 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.123354 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.123563 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.123654 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.123884 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.124005 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.124222 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.124320 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.124529 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.124628 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.124836 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.124926 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.125152 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.125243 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.125458 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.125549 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.125766 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.125854 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.126084 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.126212 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.126391 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.126506 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.127462 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.127566 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.127870 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.128000 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.128261 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.128374 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.128584 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.128691 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.128938 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.129125 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.129258 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.129461 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.129573 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.130072 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.130209 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.130209 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.130415 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.130534 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.130644 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.130813 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.130931 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.131125 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.131241 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.131437 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.131554 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.131756 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.131874 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.132095 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.132229 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.132511 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.132640 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.132751 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.132866 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.133013 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.133130 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.135421 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.135557 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.135651 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.135738 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.135829 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.135921 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.136076 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.136390 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.136500 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.136601 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.136601 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.136775 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.136870 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.136962 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.137047 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.137137 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.137220 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.137310 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.137407 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.137488 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.137559 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.137637 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.137707 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.137775 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.137854 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.140979 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.141076 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.141168 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.141243 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.141321 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.141401 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.141481 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.141558 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.141629 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.141699 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.141777 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.141848 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.141917 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.141985 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.141985 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.142766 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.142868 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.143003 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.143135 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.143249 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.144455 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.144558 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.144646 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.144736 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.144827 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.144911 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.144993 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.145084 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.145176 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.145274 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.145359 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.145448 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.145637 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.145742 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.145842 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.145842 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.145993 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.146083 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.146181 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.146274 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.146376 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.146463 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.146463 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.146613 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.146784 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.146900 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.146986 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.147075 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.147075 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.147236 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.147236 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.147528 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.147621 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.147714 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.147809 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.147948 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.148053 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.148191 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.148280 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.148378 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.148464 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.148558 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.148651 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.148742 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.148826 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.148967 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.149062 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.149160 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.149252 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.149337 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.149427 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.149510 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.149607 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.149691 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.149778 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.149883 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.149968 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.150051 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.150143 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.150228 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.150311 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.150400 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.150491 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.150582 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.150714 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.150833 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.151156 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.151266 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.151475 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.151586 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.151780 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.151873 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.152112 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.152223 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.152433 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.152538 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.152754 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.152905 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.153057 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.153142 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.153376 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.153549 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.153761 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.153919 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.154012 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.154107 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.154307 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.154414 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.154621 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.154714 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.154934 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.155035 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.155251 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.155345 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.155569 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.155662 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.155895 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.156023 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.156248 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.156342 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.156584 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.156695 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.156869 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.156999 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.157180 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.157355 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.157507 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.157794 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.157928 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.158079 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.158368 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.158463 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.158614 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 28 02:05:09.158932 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.159255 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.159570 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.160011 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.160340 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.160655 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.160983 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.161310 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.161643 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.161952 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.162273 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.162597 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.162927 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.163258 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.163578 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.163904 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.164239 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.164569 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.164898 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.165220 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.165549 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.165971 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.166301 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.166619 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.166947 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.167279 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.167591 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.167908 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.168248 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.168563 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.168872 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.169288 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.169511 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.169871 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.170139 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.170454 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.170767 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.171074 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.171399 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.171709 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.172055 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.172377 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.172707 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.173034 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.173895 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.174275 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.174658 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.174971 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.175282 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.175593 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.175942 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.176275 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.176605 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.176941 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.177276 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.177819 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.177999 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.178590 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.178590 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.178907 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.179195 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.179569 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.179801 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.180142 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.180456 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.180773 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.181082 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.181403 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.181710 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.182021 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.182326 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.182660 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.182757 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_db.sqlalchemy.engines [None req-635ecccf-b223-4a89-bccc-1ff17d39228f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116375) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 28 02:05:09.182970 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.183302 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.183619 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.185385 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.185385 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.185385 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.185385 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.185385 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.185830 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.185830 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.186144 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.186481 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.186873 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.187257 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.187623 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.187956 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.188389 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.188715 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.189717 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.190259 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.190757 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.191086 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.191421 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.191783 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.192140 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.192722 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.193062 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.193389 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.193712 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.194037 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.194359 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.194678 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.194999 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.195320 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.195640 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.195958 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.196314 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.196643 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.196976 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.197321 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.197646 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.197968 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.198289 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.198609 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.198975 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.199294 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.199606 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.199939 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.200274 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.200596 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.200915 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.201234 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.201550 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.201880 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.202183 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.202506 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.202827 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.203149 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.203481 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.203823 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.204179 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.204500 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.204972 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.205486 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.206024 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.206350 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.206692 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.207025 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.207375 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.207681 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.208026 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.208363 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.208677 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.208993 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.209311 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.209627 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.209939 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.210269 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.210589 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.210901 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.211236 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.211551 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.212117 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.212479 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.212809 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.213140 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.213470 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.214047 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.214365 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.214695 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.215011 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.215324 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.215644 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.215963 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.216299 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.216612 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.216932 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.217249 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.217559 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.217875 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.218185 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.218518 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.218828 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.219139 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.219448 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.219765 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.220142 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.220666 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.221196 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.221523 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.221846 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.222160 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.222479 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.222798 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.223116 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.223429 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.223749 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.224088 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.224434 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.224731 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.225042 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.225367 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.225684 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.226012 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.226329 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.226646 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.226996 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.227320 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.227874 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.228237 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.228581 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.229006 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.229356 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.229669 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.229982 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.230296 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.230620 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.230943 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.231259 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.231573 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.232096 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.232224 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.232549 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.232864 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.233179 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.233496 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.233816 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.234160 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.234485 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.234808 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.235128 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.235447 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.236287 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.236882 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.237331 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.237653 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.237975 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.238315 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.238634 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.238946 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.239378 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.239695 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.240047 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.240388 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.240684 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.241011 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.242213 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.242213 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.242213 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.242458 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.242568 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.242917 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.243255 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.243585 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.243896 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.244232 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.244545 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.244866 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.245205 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.245528 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.245856 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.246173 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.246499 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.246816 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.247142 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.247495 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.247789 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.248132 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.248468 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.248784 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.249103 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.249418 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.249732 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.250048 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.250363 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.250696 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.251022 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.251334 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.252483 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.252925 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.253256 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.253581 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.253905 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.254241 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.254558 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.254879 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.255197 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.255516 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.255836 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.256188 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.256522 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.256852 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.257183 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.257532 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.257868 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.258184 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.258533 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.258866 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 02:05:09.259113 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 28 02:05:09.266753 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.context [None req-635ecccf-b223-4a89-bccc-1ff17d39228f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5(cell1) {{(pid=116375) load_cells /opt/stack/nova/nova/context.py:464}} Jan 28 02:05:09.271583 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-635ecccf-b223-4a89-bccc-1ff17d39228f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:09.273222 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-635ecccf-b223-4a89-bccc-1ff17d39228f None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:09.274046 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-635ecccf-b223-4a89-bccc-1ff17d39228f None None] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:09.276173 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-635ecccf-b223-4a89-bccc-1ff17d39228f None None] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:09.281738 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_db.sqlalchemy.engines [None req-fcd32a11-06ca-4ac5-9098-54fd2f771b26 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116374) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 28 02:05:09.286633 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_db.sqlalchemy.engines [None req-635ecccf-b223-4a89-bccc-1ff17d39228f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116375) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 28 02:05:09.287854 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_db.sqlalchemy.engines [None req-635ecccf-b223-4a89-bccc-1ff17d39228f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116375) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 28 02:05:09.365204 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.context [None req-fcd32a11-06ca-4ac5-9098-54fd2f771b26 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5(cell1) {{(pid=116374) load_cells /opt/stack/nova/nova/context.py:464}} Jan 28 02:05:09.369629 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-fcd32a11-06ca-4ac5-9098-54fd2f771b26 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:09.371414 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-fcd32a11-06ca-4ac5-9098-54fd2f771b26 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:09.372268 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-fcd32a11-06ca-4ac5-9098-54fd2f771b26 None None] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:05:09.374490 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-fcd32a11-06ca-4ac5-9098-54fd2f771b26 None None] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:05:09.385823 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_db.sqlalchemy.engines [None req-fcd32a11-06ca-4ac5-9098-54fd2f771b26 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116374) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 28 02:05:09.386652 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_db.sqlalchemy.engines [None req-fcd32a11-06ca-4ac5-9098-54fd2f771b26 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116374) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 28 02:05:09.559733 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_db.sqlalchemy.engines [None req-635ecccf-b223-4a89-bccc-1ff17d39228f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116375) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 28 02:05:09.656250 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_db.sqlalchemy.engines [None req-fcd32a11-06ca-4ac5-9098-54fd2f771b26 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116374) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 28 02:05:09.897494 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: WARNING keystonemiddleware.auth_token [None req-635ecccf-b223-4a89-bccc-1ff17d39228f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 28 02:05:09.904210 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: WARNING keystonemiddleware.auth_token [None req-635ecccf-b223-4a89-bccc-1ff17d39228f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 28 02:05:09.993423 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: WARNING keystonemiddleware.auth_token [None req-fcd32a11-06ca-4ac5-9098-54fd2f771b26 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 28 02:05:10.000087 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: WARNING keystonemiddleware.auth_token [None req-fcd32a11-06ca-4ac5-9098-54fd2f771b26 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 28 02:05:10.262114 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: WARNING keystonemiddleware.auth_token [None req-635ecccf-b223-4a89-bccc-1ff17d39228f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 28 02:05:10.267675 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: WARNING keystonemiddleware.auth_token [None req-635ecccf-b223-4a89-bccc-1ff17d39228f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 28 02:05:10.272897 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x561dcb5759c0 pid: 116375 (default app) Jan 28 02:05:10.352399 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: WARNING keystonemiddleware.auth_token [None req-fcd32a11-06ca-4ac5-9098-54fd2f771b26 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 28 02:05:10.357914 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: WARNING keystonemiddleware.auth_token [None req-fcd32a11-06ca-4ac5-9098-54fd2f771b26 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 28 02:05:10.363749 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x561dcb5759c0 pid: 116374 (default app) Jan 28 02:05:59.345469 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-e210f028-5ced-4eb0-9ff8-2b1daae6583c tempest-VolumesSnapshotsTestJSON-921737102 tempest-VolumesSnapshotsTestJSON-921737102-project] Action: 'create', calling method: .version_select at 0x7f837e4ac0d0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-334367651"}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:06:01.699077 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-be6a5298-e9d0-48cb-8a2b-6ab51830ac40 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-722642286", "imageRef": "04805ce8-b0a0-41b2-b614-bfb5b752cc5d", "flavorRef": "452", "networks": [{"uuid": "d5967118-0c34-42f3-bacd-9665a804451b"}]}} {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:06:02.234356 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.network.neutron [None req-be6a5298-e9d0-48cb-8a2b-6ab51830ac40 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] validate_networks() for [('d5967118-0c34-42f3-bacd-9665a804451b', None, None, None, None, None)] {{(pid=116374) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Jan 28 02:06:02.682492 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-e210f028-5ced-4eb0-9ff8-2b1daae6583c tempest-VolumesSnapshotsTestJSON-921737102 tempest-VolumesSnapshotsTestJSON-921737102-project] 10.222.0.79 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 4.553478 Jan 28 02:06:02.726535 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 1/1] 10.222.0.79 () {60 vars in 1154 bytes} [Fri Jan 28 02:05:58 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 4562 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jan 28 02:06:02.726535 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-b38667b7-2db9-4763-9c5e-045310841c71 tempest-VolumesSnapshotsTestJSON-921737102 tempest-VolumesSnapshotsTestJSON-921737102-project] Calling method '.version_select at 0x7f837e370ca0>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:02.967320 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-b38667b7-2db9-4763-9c5e-045310841c71 tempest-VolumesSnapshotsTestJSON-921737102 tempest-VolumesSnapshotsTestJSON-921737102-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/a8b0a887-0714-4caf-9269-94e5e3d12588" status: 200 len: 344 microversion: 2.1 time: 0.271053 Jan 28 02:06:02.968331 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 2/2] 10.222.0.79 () {58 vars in 1244 bytes} [Fri Jan 28 02:06:02 2022] GET /compute/v2.1/os-volumes/a8b0a887-0714-4caf-9269-94e5e3d12588 => generated 344 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:06:03.981873 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-520c9a2c-9913-47e5-b91b-82e519ee0b1b tempest-VolumesSnapshotsTestJSON-921737102 tempest-VolumesSnapshotsTestJSON-921737102-project] Calling method '.version_select at 0x7f837e370f70>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:04.062429 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.virt.hardware [None req-be6a5298-e9d0-48cb-8a2b-6ab51830ac40 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Flavor limits 0:0:0 {{(pid=116374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 02:06:04.063848 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.virt.hardware [None req-be6a5298-e9d0-48cb-8a2b-6ab51830ac40 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Image limits 0:0:0 {{(pid=116374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 02:06:04.066172 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.virt.hardware [None req-be6a5298-e9d0-48cb-8a2b-6ab51830ac40 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Flavor pref 0:0:0 {{(pid=116374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 02:06:04.066938 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.virt.hardware [None req-be6a5298-e9d0-48cb-8a2b-6ab51830ac40 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Image pref 0:0:0 {{(pid=116374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 02:06:04.067614 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.virt.hardware [None req-be6a5298-e9d0-48cb-8a2b-6ab51830ac40 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 02:06:04.092302 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-520c9a2c-9913-47e5-b91b-82e519ee0b1b tempest-VolumesSnapshotsTestJSON-921737102 tempest-VolumesSnapshotsTestJSON-921737102-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/a8b0a887-0714-4caf-9269-94e5e3d12588" status: 200 len: 345 microversion: 2.1 time: 0.114601 Jan 28 02:06:04.093186 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 3/3] 10.222.0.79 () {58 vars in 1244 bytes} [Fri Jan 28 02:06:03 2022] GET /compute/v2.1/os-volumes/a8b0a887-0714-4caf-9269-94e5e3d12588 => generated 345 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:06:04.095595 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-be6a5298-e9d0-48cb-8a2b-6ab51830ac40 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:04.096847 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-be6a5298-e9d0-48cb-8a2b-6ab51830ac40 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:04.104997 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-be6a5298-e9d0-48cb-8a2b-6ab51830ac40 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:04.112344 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-be6a5298-e9d0-48cb-8a2b-6ab51830ac40 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:04.112540 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-0d5ca42a-7dca-4d13-99ee-cb95774fba79 tempest-VolumesSnapshotsTestJSON-921737102 tempest-VolumesSnapshotsTestJSON-921737102-project] Action: 'create', calling method: .version_select at 0x7f837e388670>, body: {"snapshot": {"volume_id": "a8b0a887-0714-4caf-9269-94e5e3d12588", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1843054169"}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:06:04.202152 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.quota [None req-be6a5298-e9d0-48cb-8a2b-6ab51830ac40 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Getting quotas for project b22dd75c99404b48a867a48eb5d10c7d. Resources: {'ram', 'cores', 'instances'} {{(pid=116374) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 02:06:04.246170 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.quota [None req-be6a5298-e9d0-48cb-8a2b-6ab51830ac40 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Getting quotas for user 891908e1e9c8409ba9e91e341d08825e and project b22dd75c99404b48a867a48eb5d10c7d. Resources: {'ram', 'cores', 'instances'} {{(pid=116374) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 02:06:04.298814 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-be6a5298-e9d0-48cb-8a2b-6ab51830ac40 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Going to run 1 instances... {{(pid=116374) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 02:06:04.308742 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-be6a5298-e9d0-48cb-8a2b-6ab51830ac40 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] [instance: c564cd2f-07df-4c91-9190-30cb5e9cb3ea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='04805ce8-b0a0-41b2-b614-bfb5b752cc5d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116374) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 02:06:04.518479 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-be6a5298-e9d0-48cb-8a2b-6ab51830ac40 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.903930 Jan 28 02:06:04.522780 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 1/4] 10.222.0.79 () {60 vars in 1146 bytes} [Fri Jan 28 02:06:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 3907 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 28 02:06:04.532518 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-4f7f15cb-1e98-4a02-b415-77102fa0dbee tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:04.534531 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-4f7f15cb-1e98-4a02-b415-77102fa0dbee tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] [instance: c564cd2f-07df-4c91-9190-30cb5e9cb3ea] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:04.812336 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-0d5ca42a-7dca-4d13-99ee-cb95774fba79 tempest-VolumesSnapshotsTestJSON-921737102 tempest-VolumesSnapshotsTestJSON-921737102-project] 10.222.0.79 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.710934 Jan 28 02:06:04.813949 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 4/5] 10.222.0.79 () {60 vars in 1161 bytes} [Fri Jan 28 02:06:04 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:06:04.825757 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-b7ecfe66-8b61-4ebb-bf24-3df896f952c7 tempest-VolumesSnapshotsTestJSON-921737102 tempest-VolumesSnapshotsTestJSON-921737102-project] Calling method '.version_select at 0x7f837e381280>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:04.892484 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-4f7f15cb-1e98-4a02-b415-77102fa0dbee tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891908e1e9c8409ba9e91e341d08825e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22dd75c99404b48a867a48eb5d10c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:04.930257 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-4f7f15cb-1e98-4a02-b415-77102fa0dbee tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] 10.222.0.79 "GET /compute/v2.1/servers/c564cd2f-07df-4c91-9190-30cb5e9cb3ea" status: 200 len: 1214 microversion: 2.1 time: 0.403770 Jan 28 02:06:04.941418 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 2/6] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:06:04 2022] GET /compute/v2.1/servers/c564cd2f-07df-4c91-9190-30cb5e9cb3ea => generated 1214 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:06:05.001472 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-b7ecfe66-8b61-4ebb-bf24-3df896f952c7 tempest-VolumesSnapshotsTestJSON-921737102 tempest-VolumesSnapshotsTestJSON-921737102-project] 10.222.0.79 "GET /compute/v2.1/os-snapshots/7fce1984-6563-4ccb-acc9-57ab06bb3144" status: 200 len: 287 microversion: 2.1 time: 0.181011 Jan 28 02:06:05.007629 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 5/7] 10.222.0.79 () {58 vars in 1250 bytes} [Fri Jan 28 02:06:04 2022] GET /compute/v2.1/os-snapshots/7fce1984-6563-4ccb-acc9-57ab06bb3144 => generated 287 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 02:06:05.012869 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-af3138ef-aa39-4cf1-9901-b3edb0f9c4d5 tempest-VolumesSnapshotsTestJSON-921737102 tempest-VolumesSnapshotsTestJSON-921737102-project] Calling method '.version_select at 0x7f837dab4160>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:05.182975 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-af3138ef-aa39-4cf1-9901-b3edb0f9c4d5 tempest-VolumesSnapshotsTestJSON-921737102 tempest-VolumesSnapshotsTestJSON-921737102-project] 10.222.0.79 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.174042 Jan 28 02:06:05.184311 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 3/8] 10.222.0.79 () {58 vars in 1139 bytes} [Fri Jan 28 02:06:05 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:06:05.195845 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-3d5099c8-edec-44f6-a7a0-3b2ee5cb5535 tempest-VolumesSnapshotsTestJSON-921737102 tempest-VolumesSnapshotsTestJSON-921737102-project] Calling method '.version_select at 0x7f837e370ee0>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:05.274020 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-3d5099c8-edec-44f6-a7a0-3b2ee5cb5535 tempest-VolumesSnapshotsTestJSON-921737102 tempest-VolumesSnapshotsTestJSON-921737102-project] 10.222.0.79 "GET /compute/v2.1/os-snapshots/7fce1984-6563-4ccb-acc9-57ab06bb3144" status: 200 len: 287 microversion: 2.1 time: 0.081493 Jan 28 02:06:05.279422 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 6/9] 10.222.0.79 () {58 vars in 1250 bytes} [Fri Jan 28 02:06:05 2022] GET /compute/v2.1/os-snapshots/7fce1984-6563-4ccb-acc9-57ab06bb3144 => generated 287 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 02:06:05.955808 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-5346d5d9-528d-4cf3-8766-44e2e6d3d713 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:05.956899 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-5346d5d9-528d-4cf3-8766-44e2e6d3d713 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] [instance: c564cd2f-07df-4c91-9190-30cb5e9cb3ea] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:06.103466 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-5346d5d9-528d-4cf3-8766-44e2e6d3d713 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891908e1e9c8409ba9e91e341d08825e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22dd75c99404b48a867a48eb5d10c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:06.127074 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-5346d5d9-528d-4cf3-8766-44e2e6d3d713 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] 10.222.0.79 "GET /compute/v2.1/servers/c564cd2f-07df-4c91-9190-30cb5e9cb3ea" status: 200 len: 1214 microversion: 2.1 time: 0.179443 Jan 28 02:06:06.127962 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 4/10] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:06:05 2022] GET /compute/v2.1/servers/c564cd2f-07df-4c91-9190-30cb5e9cb3ea => generated 1214 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:06:06.286941 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-5742e04f-bf34-4a64-867b-914b178aff90 tempest-VolumesSnapshotsTestJSON-921737102 tempest-VolumesSnapshotsTestJSON-921737102-project] Calling method '.version_select at 0x7f837e381550>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:06.365981 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-5742e04f-bf34-4a64-867b-914b178aff90 tempest-VolumesSnapshotsTestJSON-921737102 tempest-VolumesSnapshotsTestJSON-921737102-project] 10.222.0.79 "GET /compute/v2.1/os-snapshots/7fce1984-6563-4ccb-acc9-57ab06bb3144" status: 200 len: 287 microversion: 2.1 time: 0.084005 Jan 28 02:06:06.371406 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 7/11] 10.222.0.79 () {58 vars in 1250 bytes} [Fri Jan 28 02:06:06 2022] GET /compute/v2.1/os-snapshots/7fce1984-6563-4ccb-acc9-57ab06bb3144 => generated 287 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 02:06:07.155128 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-d9461d62-efc8-4b48-b4df-950e382c5aae tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:07.156184 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-d9461d62-efc8-4b48-b4df-950e382c5aae tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] [instance: c564cd2f-07df-4c91-9190-30cb5e9cb3ea] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:07.180037 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-d9461d62-efc8-4b48-b4df-950e382c5aae tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:07.182045 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-d9461d62-efc8-4b48-b4df-950e382c5aae tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:07.183831 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-d9461d62-efc8-4b48-b4df-950e382c5aae tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:07.186161 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-d9461d62-efc8-4b48-b4df-950e382c5aae tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:07.380233 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-81050008-522b-4a81-a1ff-5f306c1766da tempest-VolumesSnapshotsTestJSON-921737102 tempest-VolumesSnapshotsTestJSON-921737102-project] Calling method '.version_select at 0x7f837e3880d0>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:07.440305 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-81050008-522b-4a81-a1ff-5f306c1766da tempest-VolumesSnapshotsTestJSON-921737102 tempest-VolumesSnapshotsTestJSON-921737102-project] 10.222.0.79 "GET /compute/v2.1/os-snapshots/7fce1984-6563-4ccb-acc9-57ab06bb3144" status: 200 len: 287 microversion: 2.1 time: 0.065110 Jan 28 02:06:07.444551 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 8/12] 10.222.0.79 () {58 vars in 1250 bytes} [Fri Jan 28 02:06:07 2022] GET /compute/v2.1/os-snapshots/7fce1984-6563-4ccb-acc9-57ab06bb3144 => generated 287 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:06:07.523193 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-d9461d62-efc8-4b48-b4df-950e382c5aae tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891908e1e9c8409ba9e91e341d08825e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22dd75c99404b48a867a48eb5d10c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:07.544590 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-d9461d62-efc8-4b48-b4df-950e382c5aae tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] 10.222.0.79 "GET /compute/v2.1/servers/c564cd2f-07df-4c91-9190-30cb5e9cb3ea" status: 200 len: 1218 microversion: 2.1 time: 0.398501 Jan 28 02:06:07.555113 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 5/13] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:06:07 2022] GET /compute/v2.1/servers/c564cd2f-07df-4c91-9190-30cb5e9cb3ea => generated 1218 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:06:08.453146 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-5165133b-46a4-4780-8f41-72b006382897 tempest-VolumesSnapshotsTestJSON-921737102 tempest-VolumesSnapshotsTestJSON-921737102-project] Calling method '.version_select at 0x7f837e381f70>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:08.552476 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-5165133b-46a4-4780-8f41-72b006382897 tempest-VolumesSnapshotsTestJSON-921737102 tempest-VolumesSnapshotsTestJSON-921737102-project] 10.222.0.79 "GET /compute/v2.1/os-snapshots/7fce1984-6563-4ccb-acc9-57ab06bb3144" status: 200 len: 287 microversion: 2.1 time: 0.102470 Jan 28 02:06:08.554028 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 9/14] 10.222.0.79 () {58 vars in 1250 bytes} [Fri Jan 28 02:06:08 2022] GET /compute/v2.1/os-snapshots/7fce1984-6563-4ccb-acc9-57ab06bb3144 => generated 287 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:06:08.564621 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-92c52bee-cf2f-4860-87be-bad002885599 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:08.565282 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-92c52bee-cf2f-4860-87be-bad002885599 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] [instance: c564cd2f-07df-4c91-9190-30cb5e9cb3ea] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:08.575629 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-92c52bee-cf2f-4860-87be-bad002885599 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:08.575629 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-92c52bee-cf2f-4860-87be-bad002885599 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:08.575629 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-92c52bee-cf2f-4860-87be-bad002885599 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:08.575629 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-92c52bee-cf2f-4860-87be-bad002885599 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:08.750917 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-92c52bee-cf2f-4860-87be-bad002885599 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891908e1e9c8409ba9e91e341d08825e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22dd75c99404b48a867a48eb5d10c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:08.763742 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-92c52bee-cf2f-4860-87be-bad002885599 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] 10.222.0.79 "GET /compute/v2.1/servers/c564cd2f-07df-4c91-9190-30cb5e9cb3ea" status: 200 len: 1218 microversion: 2.1 time: 0.201468 Jan 28 02:06:08.766181 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 6/15] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:06:08 2022] GET /compute/v2.1/servers/c564cd2f-07df-4c91-9190-30cb5e9cb3ea => generated 1218 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:06:09.567198 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-8affb68c-20a7-4c0f-b455-5e06bc9da56b tempest-VolumesSnapshotsTestJSON-921737102 tempest-VolumesSnapshotsTestJSON-921737102-project] Calling method '.version_select at 0x7f837e381700>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:09.698718 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-8affb68c-20a7-4c0f-b455-5e06bc9da56b tempest-VolumesSnapshotsTestJSON-921737102 tempest-VolumesSnapshotsTestJSON-921737102-project] 10.222.0.79 "GET /compute/v2.1/os-snapshots/7fce1984-6563-4ccb-acc9-57ab06bb3144" status: 200 len: 288 microversion: 2.1 time: 0.137198 Jan 28 02:06:09.700647 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 10/16] 10.222.0.79 () {58 vars in 1250 bytes} [Fri Jan 28 02:06:09 2022] GET /compute/v2.1/os-snapshots/7fce1984-6563-4ccb-acc9-57ab06bb3144 => generated 288 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:06:09.713228 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-d0c39dca-a097-4ba8-8cfb-da4073d1d8d7 tempest-VolumesSnapshotsTestJSON-921737102 tempest-VolumesSnapshotsTestJSON-921737102-project] Calling method '.version_select at 0x7f837d1d60d0>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:09.781731 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-1fc730b4-923d-439b-b62b-3bb327bff6e2 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:09.783671 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-1fc730b4-923d-439b-b62b-3bb327bff6e2 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] [instance: c564cd2f-07df-4c91-9190-30cb5e9cb3ea] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:09.809565 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-1fc730b4-923d-439b-b62b-3bb327bff6e2 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:09.815602 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-1fc730b4-923d-439b-b62b-3bb327bff6e2 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:09.817436 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-1fc730b4-923d-439b-b62b-3bb327bff6e2 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:09.819567 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-1fc730b4-923d-439b-b62b-3bb327bff6e2 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:09.903997 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-d0c39dca-a097-4ba8-8cfb-da4073d1d8d7 tempest-VolumesSnapshotsTestJSON-921737102 tempest-VolumesSnapshotsTestJSON-921737102-project] 10.222.0.79 "DELETE /compute/v2.1/os-snapshots/7fce1984-6563-4ccb-acc9-57ab06bb3144" status: 202 len: 0 microversion: 2.1 time: 0.192072 Jan 28 02:06:09.903997 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 7/17] 10.222.0.79 () {58 vars in 1253 bytes} [Fri Jan 28 02:06:09 2022] DELETE /compute/v2.1/os-snapshots/7fce1984-6563-4ccb-acc9-57ab06bb3144 => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:06:09.910975 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-fd56b415-4f31-4131-870e-b273559369f9 tempest-VolumesSnapshotsTestJSON-921737102 tempest-VolumesSnapshotsTestJSON-921737102-project] Calling method '.version_select at 0x7f837d171e50>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:09.987832 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-fd56b415-4f31-4131-870e-b273559369f9 tempest-VolumesSnapshotsTestJSON-921737102 tempest-VolumesSnapshotsTestJSON-921737102-project] 10.222.0.79 "GET /compute/v2.1/os-snapshots/7fce1984-6563-4ccb-acc9-57ab06bb3144" status: 200 len: 287 microversion: 2.1 time: 0.082612 Jan 28 02:06:09.988683 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 8/18] 10.222.0.79 () {58 vars in 1250 bytes} [Fri Jan 28 02:06:09 2022] GET /compute/v2.1/os-snapshots/7fce1984-6563-4ccb-acc9-57ab06bb3144 => generated 287 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:06:10.208672 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-1fc730b4-923d-439b-b62b-3bb327bff6e2 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891908e1e9c8409ba9e91e341d08825e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22dd75c99404b48a867a48eb5d10c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:10.234789 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-1fc730b4-923d-439b-b62b-3bb327bff6e2 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] 10.222.0.79 "GET /compute/v2.1/servers/c564cd2f-07df-4c91-9190-30cb5e9cb3ea" status: 200 len: 1266 microversion: 2.1 time: 0.455261 Jan 28 02:06:10.235834 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 11/19] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:06:09 2022] GET /compute/v2.1/servers/c564cd2f-07df-4c91-9190-30cb5e9cb3ea => generated 1266 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:06:11.002816 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-9feb5f98-cfcf-4f0c-97e1-8e3ce95aaee8 tempest-VolumesSnapshotsTestJSON-921737102 tempest-VolumesSnapshotsTestJSON-921737102-project] Calling method '.version_select at 0x7f837d1bf700>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:11.053691 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.wsgi [None req-9feb5f98-cfcf-4f0c-97e1-8e3ce95aaee8 tempest-VolumesSnapshotsTestJSON-921737102 tempest-VolumesSnapshotsTestJSON-921737102-project] HTTP exception thrown: Snapshot 7fce1984-6563-4ccb-acc9-57ab06bb3144 could not be found. Jan 28 02:06:11.054007 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-9feb5f98-cfcf-4f0c-97e1-8e3ce95aaee8 tempest-VolumesSnapshotsTestJSON-921737102 tempest-VolumesSnapshotsTestJSON-921737102-project] Returning 404 to user: Snapshot 7fce1984-6563-4ccb-acc9-57ab06bb3144 could not be found. {{(pid=116374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 02:06:11.054887 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-9feb5f98-cfcf-4f0c-97e1-8e3ce95aaee8 tempest-VolumesSnapshotsTestJSON-921737102 tempest-VolumesSnapshotsTestJSON-921737102-project] 10.222.0.79 "GET /compute/v2.1/os-snapshots/7fce1984-6563-4ccb-acc9-57ab06bb3144" status: 404 len: 111 microversion: 2.1 time: 0.058744 Jan 28 02:06:11.058442 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 9/20] 10.222.0.79 () {58 vars in 1250 bytes} [Fri Jan 28 02:06:10 2022] GET /compute/v2.1/os-snapshots/7fce1984-6563-4ccb-acc9-57ab06bb3144 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 02:06:11.064424 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-d2715558-1c9d-473f-b764-7d4a0cb4c4b7 tempest-VolumesSnapshotsTestJSON-921737102 tempest-VolumesSnapshotsTestJSON-921737102-project] Calling method '.version_select at 0x7f837e31f9d0>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:11.253962 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-b554d4de-a7ed-4dfa-9734-71d7e98c2558 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:11.254585 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-b554d4de-a7ed-4dfa-9734-71d7e98c2558 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] [instance: c564cd2f-07df-4c91-9190-30cb5e9cb3ea] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:11.262999 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-b554d4de-a7ed-4dfa-9734-71d7e98c2558 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:11.263451 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-b554d4de-a7ed-4dfa-9734-71d7e98c2558 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:11.265576 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-b554d4de-a7ed-4dfa-9734-71d7e98c2558 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:11.267306 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-b554d4de-a7ed-4dfa-9734-71d7e98c2558 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:11.456886 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-d2715558-1c9d-473f-b764-7d4a0cb4c4b7 tempest-VolumesSnapshotsTestJSON-921737102 tempest-VolumesSnapshotsTestJSON-921737102-project] 10.222.0.79 "DELETE /compute/v2.1/os-volumes/a8b0a887-0714-4caf-9269-94e5e3d12588" status: 202 len: 0 microversion: 2.1 time: 0.393329 Jan 28 02:06:11.456886 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 12/21] 10.222.0.79 () {58 vars in 1247 bytes} [Fri Jan 28 02:06:11 2022] DELETE /compute/v2.1/os-volumes/a8b0a887-0714-4caf-9269-94e5e3d12588 => generated 0 bytes in 396 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:06:11.464746 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-7a46a274-b921-4485-8659-260aec7b9ef9 tempest-VolumesSnapshotsTestJSON-921737102 tempest-VolumesSnapshotsTestJSON-921737102-project] Calling method '.version_select at 0x7f837e2ddb80>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:11.570502 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-7a46a274-b921-4485-8659-260aec7b9ef9 tempest-VolumesSnapshotsTestJSON-921737102 tempest-VolumesSnapshotsTestJSON-921737102-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/a8b0a887-0714-4caf-9269-94e5e3d12588" status: 200 len: 344 microversion: 2.1 time: 0.110560 Jan 28 02:06:11.577627 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 13/22] 10.222.0.79 () {58 vars in 1244 bytes} [Fri Jan 28 02:06:11 2022] GET /compute/v2.1/os-volumes/a8b0a887-0714-4caf-9269-94e5e3d12588 => generated 344 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:06:11.952990 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-b554d4de-a7ed-4dfa-9734-71d7e98c2558 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891908e1e9c8409ba9e91e341d08825e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22dd75c99404b48a867a48eb5d10c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:11.970596 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-b554d4de-a7ed-4dfa-9734-71d7e98c2558 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] 10.222.0.79 "GET /compute/v2.1/servers/c564cd2f-07df-4c91-9190-30cb5e9cb3ea" status: 200 len: 1272 microversion: 2.1 time: 0.719770 Jan 28 02:06:11.978111 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 10/23] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:06:11 2022] GET /compute/v2.1/servers/c564cd2f-07df-4c91-9190-30cb5e9cb3ea => generated 1272 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:06:12.717411 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-8718d30b-4bc8-4d81-9ccf-f22d872653bc tempest-VolumesSnapshotsTestJSON-921737102 tempest-VolumesSnapshotsTestJSON-921737102-project] Calling method '.version_select at 0x7f837e2ddf70>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:12.765082 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-8718d30b-4bc8-4d81-9ccf-f22d872653bc tempest-VolumesSnapshotsTestJSON-921737102 tempest-VolumesSnapshotsTestJSON-921737102-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/a8b0a887-0714-4caf-9269-94e5e3d12588" status: 200 len: 344 microversion: 2.1 time: 0.184373 Jan 28 02:06:12.774891 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 14/24] 10.222.0.79 () {58 vars in 1244 bytes} [Fri Jan 28 02:06:12 2022] GET /compute/v2.1/os-volumes/a8b0a887-0714-4caf-9269-94e5e3d12588 => generated 344 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:06:12.996965 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-b16f83ce-facc-42d6-8f59-e95a2ea47945 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:12.998441 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-b16f83ce-facc-42d6-8f59-e95a2ea47945 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] [instance: c564cd2f-07df-4c91-9190-30cb5e9cb3ea] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:13.006987 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-b16f83ce-facc-42d6-8f59-e95a2ea47945 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:13.007443 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-b16f83ce-facc-42d6-8f59-e95a2ea47945 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:13.008250 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-b16f83ce-facc-42d6-8f59-e95a2ea47945 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:13.008688 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-b16f83ce-facc-42d6-8f59-e95a2ea47945 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:13.291165 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-b16f83ce-facc-42d6-8f59-e95a2ea47945 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891908e1e9c8409ba9e91e341d08825e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22dd75c99404b48a867a48eb5d10c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:13.303620 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-b16f83ce-facc-42d6-8f59-e95a2ea47945 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] 10.222.0.79 "GET /compute/v2.1/servers/c564cd2f-07df-4c91-9190-30cb5e9cb3ea" status: 200 len: 1272 microversion: 2.1 time: 0.313911 Jan 28 02:06:13.305315 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 11/25] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:06:12 2022] GET /compute/v2.1/servers/c564cd2f-07df-4c91-9190-30cb5e9cb3ea => generated 1272 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:06:13.482522 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-7a89bdcc-10ff-4cd2-9cb7-6f5aa05bfa03 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1019812925", "imageRef": "04805ce8-b0a0-41b2-b614-bfb5b752cc5d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:06:13.657653 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.network.neutron [None req-7a89bdcc-10ff-4cd2-9cb7-6f5aa05bfa03 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] validate_networks() for [('8ef75d94-d93d-4873-9fc3-216697a025d1', None, None, None, None, None)] {{(pid=116375) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Jan 28 02:06:13.787801 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-11228101-64e7-4ae6-b56b-2257e52fec7d tempest-VolumesSnapshotsTestJSON-921737102 tempest-VolumesSnapshotsTestJSON-921737102-project] Calling method '.version_select at 0x7f837d1bf310>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:13.989057 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-11228101-64e7-4ae6-b56b-2257e52fec7d tempest-VolumesSnapshotsTestJSON-921737102 tempest-VolumesSnapshotsTestJSON-921737102-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/a8b0a887-0714-4caf-9269-94e5e3d12588" status: 200 len: 344 microversion: 2.1 time: 0.205696 Jan 28 02:06:13.990016 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 12/26] 10.222.0.79 () {58 vars in 1244 bytes} [Fri Jan 28 02:06:13 2022] GET /compute/v2.1/os-volumes/a8b0a887-0714-4caf-9269-94e5e3d12588 => generated 344 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:06:14.167285 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-ccb99709-9130-4767-9194-e8fa2bd10bda tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Action: 'create', calling method: .version_select at 0x7f837d171790>, body: {"keypair": {"name": "tempest-keypair-1952223728"}} {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:06:14.243896 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.quota [None req-ccb99709-9130-4767-9194-e8fa2bd10bda tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Getting quotas for project 6bdd27e926a84fa49844fbcca271bb19. Resources: {'key_pairs'} {{(pid=116374) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 02:06:14.252580 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.quota [None req-ccb99709-9130-4767-9194-e8fa2bd10bda tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Getting quotas for user a6e7ef3a7fd145e5ab8726786ba318bb and project 6bdd27e926a84fa49844fbcca271bb19. Resources: {'key_pairs'} {{(pid=116374) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 02:06:14.583584 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.quota [None req-ccb99709-9130-4767-9194-e8fa2bd10bda tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Getting quotas for project 6bdd27e926a84fa49844fbcca271bb19. Resources: {'key_pairs'} {{(pid=116374) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 02:06:14.610755 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.quota [None req-ccb99709-9130-4767-9194-e8fa2bd10bda tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Getting quotas for user a6e7ef3a7fd145e5ab8726786ba318bb and project 6bdd27e926a84fa49844fbcca271bb19. Resources: {'key_pairs'} {{(pid=116374) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 02:06:14.656382 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-ccb99709-9130-4767-9194-e8fa2bd10bda tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.20 time: 0.605306 Jan 28 02:06:14.671780 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 13/27] 10.222.0.79 () {62 vars in 1198 bytes} [Fri Jan 28 02:06:14 2022] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 621 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Jan 28 02:06:14.684418 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-0e94a65c-6f8f-49fc-9085-5741b997464a tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:14.684418 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-0e94a65c-6f8f-49fc-9085-5741b997464a tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] [instance: c564cd2f-07df-4c91-9190-30cb5e9cb3ea] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:14.688491 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-0e94a65c-6f8f-49fc-9085-5741b997464a tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:14.689429 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-0e94a65c-6f8f-49fc-9085-5741b997464a tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:14.690460 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-0e94a65c-6f8f-49fc-9085-5741b997464a tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:14.691039 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-0e94a65c-6f8f-49fc-9085-5741b997464a tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:15.377118 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-0e94a65c-6f8f-49fc-9085-5741b997464a tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891908e1e9c8409ba9e91e341d08825e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22dd75c99404b48a867a48eb5d10c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:15.428260 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-0e94a65c-6f8f-49fc-9085-5741b997464a tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] 10.222.0.79 "GET /compute/v2.1/servers/c564cd2f-07df-4c91-9190-30cb5e9cb3ea" status: 200 len: 1314 microversion: 2.1 time: 0.747054 Jan 28 02:06:15.429024 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 14/28] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:06:14 2022] GET /compute/v2.1/servers/c564cd2f-07df-4c91-9190-30cb5e9cb3ea => generated 1314 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:06:15.438686 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-323a80f7-4f62-42cb-9f85-9c8bc3c05af7 tempest-VolumesSnapshotsTestJSON-921737102 tempest-VolumesSnapshotsTestJSON-921737102-project] Calling method '.version_select at 0x7f837d158940>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:15.535492 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.virt.hardware [None req-7a89bdcc-10ff-4cd2-9cb7-6f5aa05bfa03 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Flavor limits 0:0:0 {{(pid=116375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 02:06:15.536017 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.virt.hardware [None req-7a89bdcc-10ff-4cd2-9cb7-6f5aa05bfa03 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Image limits 0:0:0 {{(pid=116375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 02:06:15.536604 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.virt.hardware [None req-7a89bdcc-10ff-4cd2-9cb7-6f5aa05bfa03 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Flavor pref 0:0:0 {{(pid=116375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 02:06:15.537123 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.virt.hardware [None req-7a89bdcc-10ff-4cd2-9cb7-6f5aa05bfa03 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Image pref 0:0:0 {{(pid=116375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 02:06:15.537733 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.virt.hardware [None req-7a89bdcc-10ff-4cd2-9cb7-6f5aa05bfa03 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 02:06:15.556862 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.wsgi [None req-323a80f7-4f62-42cb-9f85-9c8bc3c05af7 tempest-VolumesSnapshotsTestJSON-921737102 tempest-VolumesSnapshotsTestJSON-921737102-project] HTTP exception thrown: Volume a8b0a887-0714-4caf-9269-94e5e3d12588 could not be found. Jan 28 02:06:15.557648 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-323a80f7-4f62-42cb-9f85-9c8bc3c05af7 tempest-VolumesSnapshotsTestJSON-921737102 tempest-VolumesSnapshotsTestJSON-921737102-project] Returning 404 to user: Volume a8b0a887-0714-4caf-9269-94e5e3d12588 could not be found. {{(pid=116374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 02:06:15.558738 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-323a80f7-4f62-42cb-9f85-9c8bc3c05af7 tempest-VolumesSnapshotsTestJSON-921737102 tempest-VolumesSnapshotsTestJSON-921737102-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/a8b0a887-0714-4caf-9269-94e5e3d12588" status: 404 len: 109 microversion: 2.1 time: 0.124229 Jan 28 02:06:15.559341 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 15/29] 10.222.0.79 () {58 vars in 1244 bytes} [Fri Jan 28 02:06:15 2022] GET /compute/v2.1/os-volumes/a8b0a887-0714-4caf-9269-94e5e3d12588 => generated 109 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 02:06:15.568922 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-d1296047-a380-43b4-9cf5-1f3262e675ae tempest-VolumesSnapshotsTestJSON-921737102 tempest-VolumesSnapshotsTestJSON-921737102-project] Calling method '.version_select at 0x7f837c8e9700>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:15.603684 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-7a89bdcc-10ff-4cd2-9cb7-6f5aa05bfa03 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:15.604516 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-7a89bdcc-10ff-4cd2-9cb7-6f5aa05bfa03 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:15.609850 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-7a89bdcc-10ff-4cd2-9cb7-6f5aa05bfa03 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:15.610676 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-7a89bdcc-10ff-4cd2-9cb7-6f5aa05bfa03 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:15.661035 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.wsgi [None req-d1296047-a380-43b4-9cf5-1f3262e675ae tempest-VolumesSnapshotsTestJSON-921737102 tempest-VolumesSnapshotsTestJSON-921737102-project] HTTP exception thrown: Volume a8b0a887-0714-4caf-9269-94e5e3d12588 could not be found. Jan 28 02:06:15.661993 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-d1296047-a380-43b4-9cf5-1f3262e675ae tempest-VolumesSnapshotsTestJSON-921737102 tempest-VolumesSnapshotsTestJSON-921737102-project] Returning 404 to user: Volume a8b0a887-0714-4caf-9269-94e5e3d12588 could not be found. {{(pid=116374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 02:06:15.663167 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-d1296047-a380-43b4-9cf5-1f3262e675ae tempest-VolumesSnapshotsTestJSON-921737102 tempest-VolumesSnapshotsTestJSON-921737102-project] 10.222.0.79 "DELETE /compute/v2.1/os-volumes/a8b0a887-0714-4caf-9269-94e5e3d12588" status: 404 len: 109 microversion: 2.1 time: 0.097816 Jan 28 02:06:15.667257 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 16/30] 10.222.0.79 () {58 vars in 1247 bytes} [Fri Jan 28 02:06:15 2022] DELETE /compute/v2.1/os-volumes/a8b0a887-0714-4caf-9269-94e5e3d12588 => generated 109 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 28 02:06:15.673156 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-cd232d8e-9f05-447e-ac6f-0b1dd5e59e79 tempest-VolumesSnapshotsTestJSON-921737102 tempest-VolumesSnapshotsTestJSON-921737102-project] Calling method '.version_select at 0x7f837d158790>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:15.698582 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.quota [None req-7a89bdcc-10ff-4cd2-9cb7-6f5aa05bfa03 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Getting quotas for project cc19a0f9c33f47f1b504bebbb0b2c931. Resources: {'ram', 'cores', 'instances'} {{(pid=116375) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 02:06:15.730383 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.quota [None req-7a89bdcc-10ff-4cd2-9cb7-6f5aa05bfa03 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Getting quotas for user 8fd7039b8f074a13b2030a2bb7aaff94 and project cc19a0f9c33f47f1b504bebbb0b2c931. Resources: {'ram', 'cores', 'instances'} {{(pid=116375) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 02:06:15.780675 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-7a89bdcc-10ff-4cd2-9cb7-6f5aa05bfa03 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Going to run 1 instances... {{(pid=116375) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 02:06:15.795478 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-7a89bdcc-10ff-4cd2-9cb7-6f5aa05bfa03 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] [instance: ec5e47ac-761b-467f-958c-516a9f8bc3e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='04805ce8-b0a0-41b2-b614-bfb5b752cc5d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116375) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 02:06:15.832518 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.wsgi [None req-cd232d8e-9f05-447e-ac6f-0b1dd5e59e79 tempest-VolumesSnapshotsTestJSON-921737102 tempest-VolumesSnapshotsTestJSON-921737102-project] HTTP exception thrown: Volume a8b0a887-0714-4caf-9269-94e5e3d12588 could not be found. Jan 28 02:06:15.836082 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-cd232d8e-9f05-447e-ac6f-0b1dd5e59e79 tempest-VolumesSnapshotsTestJSON-921737102 tempest-VolumesSnapshotsTestJSON-921737102-project] Returning 404 to user: Volume a8b0a887-0714-4caf-9269-94e5e3d12588 could not be found. {{(pid=116374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 02:06:15.836082 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-cd232d8e-9f05-447e-ac6f-0b1dd5e59e79 tempest-VolumesSnapshotsTestJSON-921737102 tempest-VolumesSnapshotsTestJSON-921737102-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/a8b0a887-0714-4caf-9269-94e5e3d12588" status: 404 len: 109 microversion: 2.1 time: 0.165905 Jan 28 02:06:15.836082 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 17/31] 10.222.0.79 () {58 vars in 1244 bytes} [Fri Jan 28 02:06:15 2022] GET /compute/v2.1/os-volumes/a8b0a887-0714-4caf-9269-94e5e3d12588 => generated 109 bytes in 168 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 02:06:16.083759 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-7a89bdcc-10ff-4cd2-9cb7-6f5aa05bfa03 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.911038 Jan 28 02:06:16.085203 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 15/32] 10.222.0.79 () {60 vars in 1146 bytes} [Fri Jan 28 02:06:13 2022] POST /compute/v2.1/servers => generated 383 bytes in 2913 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 28 02:06:16.123630 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-8692bba7-1a8e-4e47-8d55-9c1543e0eb06 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:16.130709 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-8692bba7-1a8e-4e47-8d55-9c1543e0eb06 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] [instance: ec5e47ac-761b-467f-958c-516a9f8bc3e6] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:16.840883 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-8692bba7-1a8e-4e47-8d55-9c1543e0eb06 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd7039b8f074a13b2030a2bb7aaff94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc19a0f9c33f47f1b504bebbb0b2c931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:16.849275 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-8692bba7-1a8e-4e47-8d55-9c1543e0eb06 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] 10.222.0.79 "GET /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6" status: 200 len: 1222 microversion: 2.1 time: 0.757103 Jan 28 02:06:16.850424 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 18/33] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:06:16 2022] GET /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6 => generated 1222 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:06:16.866314 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-3fef6123-f849-4817-aef7-8df048dd34ee tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:16.867098 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-3fef6123-f849-4817-aef7-8df048dd34ee tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] [instance: c564cd2f-07df-4c91-9190-30cb5e9cb3ea] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:16.882719 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-3fef6123-f849-4817-aef7-8df048dd34ee tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:16.885023 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-3fef6123-f849-4817-aef7-8df048dd34ee tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:16.885916 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-3fef6123-f849-4817-aef7-8df048dd34ee tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:16.886471 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-3fef6123-f849-4817-aef7-8df048dd34ee tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:17.147423 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-738d5977-7d24-4de0-b84d-75ca5215f32f tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Action: 'create', calling method: .version_select at 0x7f837e259430>, body: {"keypair": {"name": "tempest-keypair-1079325533"}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:06:17.237295 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.quota [None req-738d5977-7d24-4de0-b84d-75ca5215f32f tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Getting quotas for project 0abe012ba65845329098e0e06c54b9c1. Resources: {'key_pairs'} {{(pid=116375) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 02:06:17.261341 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.quota [None req-738d5977-7d24-4de0-b84d-75ca5215f32f tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Getting quotas for user acab2a0c4a0e48909317791a3de85b53 and project 0abe012ba65845329098e0e06c54b9c1. Resources: {'key_pairs'} {{(pid=116375) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 02:06:17.342470 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-3fef6123-f849-4817-aef7-8df048dd34ee tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891908e1e9c8409ba9e91e341d08825e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22dd75c99404b48a867a48eb5d10c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:17.368001 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-3fef6123-f849-4817-aef7-8df048dd34ee tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] 10.222.0.79 "GET /compute/v2.1/servers/c564cd2f-07df-4c91-9190-30cb5e9cb3ea" status: 200 len: 1314 microversion: 2.1 time: 0.514765 Jan 28 02:06:17.371582 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 19/34] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:06:16 2022] GET /compute/v2.1/servers/c564cd2f-07df-4c91-9190-30cb5e9cb3ea => generated 1314 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:06:17.792946 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-a1b118ea-8a03-48d0-aa3b-b309d5ae5142 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-118515245", "imageRef": "04805ce8-b0a0-41b2-b614-bfb5b752cc5d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:06:17.859557 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.quota [None req-738d5977-7d24-4de0-b84d-75ca5215f32f tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Getting quotas for project 0abe012ba65845329098e0e06c54b9c1. Resources: {'key_pairs'} {{(pid=116375) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 02:06:17.882088 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.quota [None req-738d5977-7d24-4de0-b84d-75ca5215f32f tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Getting quotas for user acab2a0c4a0e48909317791a3de85b53 and project 0abe012ba65845329098e0e06c54b9c1. Resources: {'key_pairs'} {{(pid=116375) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 02:06:18.005321 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-738d5977-7d24-4de0-b84d-75ca5215f32f tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 1.571475 Jan 28 02:06:18.009557 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 16/35] 10.222.0.79 () {60 vars in 1157 bytes} [Fri Jan 28 02:06:16 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 1585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:06:18.134987 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.network.neutron [None req-a1b118ea-8a03-48d0-aa3b-b309d5ae5142 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] validate_networks() for [('8ef75d94-d93d-4873-9fc3-216697a025d1', None, None, None, None, None)] {{(pid=116374) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Jan 28 02:06:18.389619 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-6b1431fd-4f9d-4388-b7a2-5a5ccfb003ff tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:18.391764 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-6b1431fd-4f9d-4388-b7a2-5a5ccfb003ff tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] [instance: c564cd2f-07df-4c91-9190-30cb5e9cb3ea] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:18.411438 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-6b1431fd-4f9d-4388-b7a2-5a5ccfb003ff tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:18.417226 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-6b1431fd-4f9d-4388-b7a2-5a5ccfb003ff tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:18.422340 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-6b1431fd-4f9d-4388-b7a2-5a5ccfb003ff tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:18.429531 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-6b1431fd-4f9d-4388-b7a2-5a5ccfb003ff tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:19.337457 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-6b1431fd-4f9d-4388-b7a2-5a5ccfb003ff tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891908e1e9c8409ba9e91e341d08825e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22dd75c99404b48a867a48eb5d10c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:19.367247 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-6b1431fd-4f9d-4388-b7a2-5a5ccfb003ff tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] 10.222.0.79 "GET /compute/v2.1/servers/c564cd2f-07df-4c91-9190-30cb5e9cb3ea" status: 200 len: 1314 microversion: 2.1 time: 0.982360 Jan 28 02:06:19.371242 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 17/36] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:06:18 2022] GET /compute/v2.1/servers/c564cd2f-07df-4c91-9190-30cb5e9cb3ea => generated 1314 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:06:20.062697 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [req-7a2699a0-456d-41e9-a7bd-335959555530 req-925ae525-a4c5-4b75-ab88-16614efec583 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c564cd2f-07df-4c91-9190-30cb5e9cb3ea", "tag": "f7f220d5-8156-4a22-9350-5b5670680867"}]} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:06:20.066819 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:06:20.066819 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: warnings.warn(msg) Jan 28 02:06:20.095647 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-7a2699a0-456d-41e9-a7bd-335959555530 req-925ae525-a4c5-4b75-ab88-16614efec583 service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:20.096769 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-7a2699a0-456d-41e9-a7bd-335959555530 req-925ae525-a4c5-4b75-ab88-16614efec583 service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:20.133647 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.compute.server_external_events [req-7a2699a0-456d-41e9-a7bd-335959555530 req-925ae525-a4c5-4b75-ab88-16614efec583 service nova] Creating event network-changed:f7f220d5-8156-4a22-9350-5b5670680867 for instance c564cd2f-07df-4c91-9190-30cb5e9cb3ea on hv-cinder-82497 Jan 28 02:06:20.135133 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-7a2699a0-456d-41e9-a7bd-335959555530 req-925ae525-a4c5-4b75-ab88-16614efec583 service nova] Acquired lock "compute-rpcapi-router" {{(pid=116375) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Jan 28 02:06:20.137796 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-aef8e262-392a-4b74-8bf5-ea0399f1b0c2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:20.138262 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-aef8e262-392a-4b74-8bf5-ea0399f1b0c2 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:20.163855 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-aef8e262-392a-4b74-8bf5-ea0399f1b0c2 None None] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:20.164753 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-aef8e262-392a-4b74-8bf5-ea0399f1b0c2 None None] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:20.197076 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.compute.rpcapi [None req-aef8e262-392a-4b74-8bf5-ea0399f1b0c2 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Jan 28 02:06:20.203077 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-aef8e262-392a-4b74-8bf5-ea0399f1b0c2 None None] Releasing lock "compute-rpcapi-router" {{(pid=116375) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Jan 28 02:06:20.257777 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-aef8e262-392a-4b74-8bf5-ea0399f1b0c2 None None] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.289311 Jan 28 02:06:20.258916 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 18/37] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Jan 28 02:06:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 02:06:20.396030 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-7d5d7b2f-d9f8-4388-b492-89401be6a798 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:20.396030 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-7d5d7b2f-d9f8-4388-b492-89401be6a798 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] [instance: c564cd2f-07df-4c91-9190-30cb5e9cb3ea] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:20.400113 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-7d5d7b2f-d9f8-4388-b492-89401be6a798 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:20.404854 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-7d5d7b2f-d9f8-4388-b492-89401be6a798 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:20.405835 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-7d5d7b2f-d9f8-4388-b492-89401be6a798 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:20.406289 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-7d5d7b2f-d9f8-4388-b492-89401be6a798 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:21.153518 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.virt.hardware [None req-a1b118ea-8a03-48d0-aa3b-b309d5ae5142 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Flavor limits 0:0:0 {{(pid=116374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 02:06:21.153518 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.virt.hardware [None req-a1b118ea-8a03-48d0-aa3b-b309d5ae5142 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Image limits 0:0:0 {{(pid=116374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 02:06:21.153518 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.virt.hardware [None req-a1b118ea-8a03-48d0-aa3b-b309d5ae5142 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Flavor pref 0:0:0 {{(pid=116374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 02:06:21.153518 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.virt.hardware [None req-a1b118ea-8a03-48d0-aa3b-b309d5ae5142 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Image pref 0:0:0 {{(pid=116374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 02:06:21.153518 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.virt.hardware [None req-a1b118ea-8a03-48d0-aa3b-b309d5ae5142 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 02:06:21.166613 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-a1b118ea-8a03-48d0-aa3b-b309d5ae5142 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:21.174444 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-a1b118ea-8a03-48d0-aa3b-b309d5ae5142 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:21.177704 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-a1b118ea-8a03-48d0-aa3b-b309d5ae5142 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:21.178294 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-a1b118ea-8a03-48d0-aa3b-b309d5ae5142 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:21.262716 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.quota [None req-a1b118ea-8a03-48d0-aa3b-b309d5ae5142 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Getting quotas for project cc19a0f9c33f47f1b504bebbb0b2c931. Resources: {'ram', 'cores', 'instances'} {{(pid=116374) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 02:06:21.273902 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.quota [None req-a1b118ea-8a03-48d0-aa3b-b309d5ae5142 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Getting quotas for user 8fd7039b8f074a13b2030a2bb7aaff94 and project cc19a0f9c33f47f1b504bebbb0b2c931. Resources: {'ram', 'cores', 'instances'} {{(pid=116374) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 02:06:21.293315 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-a1b118ea-8a03-48d0-aa3b-b309d5ae5142 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Going to run 1 instances... {{(pid=116374) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 02:06:21.296851 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-a1b118ea-8a03-48d0-aa3b-b309d5ae5142 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] [instance: 2f0bfba5-38f6-4375-a6bf-25959ad11fe0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='04805ce8-b0a0-41b2-b614-bfb5b752cc5d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116374) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 02:06:21.654309 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-7d5d7b2f-d9f8-4388-b492-89401be6a798 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891908e1e9c8409ba9e91e341d08825e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22dd75c99404b48a867a48eb5d10c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:21.669793 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-7d5d7b2f-d9f8-4388-b492-89401be6a798 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] 10.222.0.79 "GET /compute/v2.1/servers/c564cd2f-07df-4c91-9190-30cb5e9cb3ea" status: 200 len: 1314 microversion: 2.1 time: 1.285423 Jan 28 02:06:21.695350 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 19/38] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:06:20 2022] GET /compute/v2.1/servers/c564cd2f-07df-4c91-9190-30cb5e9cb3ea => generated 1314 bytes in 1306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:06:21.695582 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-a1b118ea-8a03-48d0-aa3b-b309d5ae5142 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.908842 Jan 28 02:06:21.710605 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 20/39] 10.222.0.79 () {60 vars in 1146 bytes} [Fri Jan 28 02:06:17 2022] POST /compute/v2.1/servers => generated 383 bytes in 3924 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jan 28 02:06:21.716883 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-953c7fa0-f6b5-48f5-851c-2b13340d034a tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:21.717492 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-953c7fa0-f6b5-48f5-851c-2b13340d034a tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] [instance: 2f0bfba5-38f6-4375-a6bf-25959ad11fe0] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:22.218681 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-953c7fa0-f6b5-48f5-851c-2b13340d034a tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd7039b8f074a13b2030a2bb7aaff94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc19a0f9c33f47f1b504bebbb0b2c931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:22.233671 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-953c7fa0-f6b5-48f5-851c-2b13340d034a tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] 10.222.0.79 "GET /compute/v2.1/servers/2f0bfba5-38f6-4375-a6bf-25959ad11fe0" status: 200 len: 1221 microversion: 2.1 time: 0.521408 Jan 28 02:06:22.234943 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 20/40] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:06:21 2022] GET /compute/v2.1/servers/2f0bfba5-38f6-4375-a6bf-25959ad11fe0 => generated 1221 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:06:22.687477 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-3ac6eebf-71c6-478a-8cad-12761a804289 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:22.688731 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-3ac6eebf-71c6-478a-8cad-12761a804289 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] [instance: c564cd2f-07df-4c91-9190-30cb5e9cb3ea] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:22.700899 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-3ac6eebf-71c6-478a-8cad-12761a804289 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:22.706709 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-3ac6eebf-71c6-478a-8cad-12761a804289 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:22.721945 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-3ac6eebf-71c6-478a-8cad-12761a804289 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:22.730534 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-3ac6eebf-71c6-478a-8cad-12761a804289 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:23.260739 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-af6faa83-e855-4836-8676-8c1de1d64171 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:23.260739 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-af6faa83-e855-4836-8676-8c1de1d64171 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] [instance: 2f0bfba5-38f6-4375-a6bf-25959ad11fe0] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:23.487067 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-af6faa83-e855-4836-8676-8c1de1d64171 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd7039b8f074a13b2030a2bb7aaff94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc19a0f9c33f47f1b504bebbb0b2c931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:23.506266 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-af6faa83-e855-4836-8676-8c1de1d64171 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] 10.222.0.79 "GET /compute/v2.1/servers/2f0bfba5-38f6-4375-a6bf-25959ad11fe0" status: 200 len: 1221 microversion: 2.1 time: 0.257823 Jan 28 02:06:23.508482 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 21/41] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:06:23 2022] GET /compute/v2.1/servers/2f0bfba5-38f6-4375-a6bf-25959ad11fe0 => generated 1221 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:06:24.211456 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-3ac6eebf-71c6-478a-8cad-12761a804289 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891908e1e9c8409ba9e91e341d08825e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22dd75c99404b48a867a48eb5d10c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:24.227567 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-3ac6eebf-71c6-478a-8cad-12761a804289 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] 10.222.0.79 "GET /compute/v2.1/servers/c564cd2f-07df-4c91-9190-30cb5e9cb3ea" status: 200 len: 1314 microversion: 2.1 time: 1.535856 Jan 28 02:06:24.228281 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 21/42] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:06:22 2022] GET /compute/v2.1/servers/c564cd2f-07df-4c91-9190-30cb5e9cb3ea => generated 1314 bytes in 1545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:06:24.523440 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-3b4ae625-50ec-4481-b77e-03b213457d05 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:24.524083 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-3b4ae625-50ec-4481-b77e-03b213457d05 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] [instance: 2f0bfba5-38f6-4375-a6bf-25959ad11fe0] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:24.535837 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-3b4ae625-50ec-4481-b77e-03b213457d05 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:24.536690 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-3b4ae625-50ec-4481-b77e-03b213457d05 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:24.537250 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-3b4ae625-50ec-4481-b77e-03b213457d05 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:24.537542 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-3b4ae625-50ec-4481-b77e-03b213457d05 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:24.770621 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-a872dba3-90b8-4f38-bb96-4bc2b8aed3fb tempest-VolumesNegativeTest-562038795 tempest-VolumesNegativeTest-562038795-project] Action: 'create', calling method: .version_select at 0x7f837d99eca0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-266012518", "metadata": {"Type": "work"}}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:06:24.773825 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-a872dba3-90b8-4f38-bb96-4bc2b8aed3fb tempest-VolumesNegativeTest-562038795 tempest-VolumesNegativeTest-562038795-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=116375) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 02:06:24.774954 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-a872dba3-90b8-4f38-bb96-4bc2b8aed3fb tempest-VolumesNegativeTest-562038795 tempest-VolumesNegativeTest-562038795-project] 10.222.0.79 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.733424 Jan 28 02:06:24.776160 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 22/43] 10.222.0.79 () {60 vars in 1155 bytes} [Fri Jan 28 02:06:24 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 735 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jan 28 02:06:24.826568 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-ca416e98-e5a6-4dd5-acbf-4c63ececaf89 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1242973625", "imageRef": "04805ce8-b0a0-41b2-b614-bfb5b752cc5d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "93f7fa36-86c7-4eac-8e6a-71166645bc4a"}], "security_groups": [{"name": "tempest-securitygroup--1735441935"}], "key_name": "tempest-keypair-1952223728", "user_data": "}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:06:24.861953 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-3b4ae625-50ec-4481-b77e-03b213457d05 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd7039b8f074a13b2030a2bb7aaff94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc19a0f9c33f47f1b504bebbb0b2c931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:24.891698 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-3b4ae625-50ec-4481-b77e-03b213457d05 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] 10.222.0.79 "GET /compute/v2.1/servers/2f0bfba5-38f6-4375-a6bf-25959ad11fe0" status: 200 len: 1225 microversion: 2.1 time: 0.353484 Jan 28 02:06:24.892621 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 22/44] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:06:24 2022] GET /compute/v2.1/servers/2f0bfba5-38f6-4375-a6bf-25959ad11fe0 => generated 1225 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:06:24.897355 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-f5d5632d-b9fb-4406-90e9-ec6bdf0ca4b8 tempest-VolumesNegativeTest-562038795 tempest-VolumesNegativeTest-562038795-project] Action: 'create', calling method: .version_select at 0x7f837d158040>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-212603732", "metadata": {"Type": "work"}}} {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:06:24.929693 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-f5d5632d-b9fb-4406-90e9-ec6bdf0ca4b8 tempest-VolumesNegativeTest-562038795 tempest-VolumesNegativeTest-562038795-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=116374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 02:06:24.934010 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-f5d5632d-b9fb-4406-90e9-ec6bdf0ca4b8 tempest-VolumesNegativeTest-562038795 tempest-VolumesNegativeTest-562038795-project] 10.222.0.79 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.040124 Jan 28 02:06:24.940058 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 23/45] 10.222.0.79 () {60 vars in 1155 bytes} [Fri Jan 28 02:06:24 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 42 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 28 02:06:24.957184 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-0a9658df-4567-4de9-bbb2-9e7adc49090e tempest-VolumesNegativeTest-562038795 tempest-VolumesNegativeTest-562038795-project] Action: 'create', calling method: .version_select at 0x7f837c8e94c0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1176398984", "metadata": {"Type": "work"}}} {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:06:24.958469 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-0a9658df-4567-4de9-bbb2-9e7adc49090e tempest-VolumesNegativeTest-562038795 tempest-VolumesNegativeTest-562038795-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=116374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 02:06:24.959303 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-0a9658df-4567-4de9-bbb2-9e7adc49090e tempest-VolumesNegativeTest-562038795 tempest-VolumesNegativeTest-562038795-project] 10.222.0.79 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.014173 Jan 28 02:06:24.968234 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 24/46] 10.222.0.79 () {60 vars in 1155 bytes} [Fri Jan 28 02:06:24 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jan 28 02:06:24.973886 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-601ca2af-8f53-4447-8717-5440216d4595 tempest-VolumesNegativeTest-562038795 tempest-VolumesNegativeTest-562038795-project] Calling method '.version_select at 0x7f837c8e94c0>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:25.057802 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.wsgi [None req-601ca2af-8f53-4447-8717-5440216d4595 tempest-VolumesNegativeTest-562038795 tempest-VolumesNegativeTest-562038795-project] HTTP exception thrown: Volume tempest-invalid-1333156516 could not be found. Jan 28 02:06:25.058408 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-601ca2af-8f53-4447-8717-5440216d4595 tempest-VolumesNegativeTest-562038795 tempest-VolumesNegativeTest-562038795-project] Returning 404 to user: Volume tempest-invalid-1333156516 could not be found. {{(pid=116374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 02:06:25.059445 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-601ca2af-8f53-4447-8717-5440216d4595 tempest-VolumesNegativeTest-562038795 tempest-VolumesNegativeTest-562038795-project] 10.222.0.79 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1333156516" status: 404 len: 99 microversion: 2.1 time: 0.090153 Jan 28 02:06:25.060009 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 25/47] 10.222.0.79 () {58 vars in 1217 bytes} [Fri Jan 28 02:06:24 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1333156516 => generated 99 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jan 28 02:06:25.070491 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-57301771-86fd-4416-a1f1-dd77b011ca34 tempest-VolumesNegativeTest-562038795 tempest-VolumesNegativeTest-562038795-project] 10.222.0.79 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004123 Jan 28 02:06:25.092058 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 26/48] 10.222.0.79 () {58 vars in 1139 bytes} [Fri Jan 28 02:06:25 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 26 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jan 28 02:06:25.125307 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-02bb72d1-20aa-40f7-a625-fd4b1a3e69ac tempest-VolumesNegativeTest-562038795 tempest-VolumesNegativeTest-562038795-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.031792 Jan 28 02:06:25.126047 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 27/49] 10.222.0.79 () {58 vars in 1136 bytes} [Fri Jan 28 02:06:25 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jan 28 02:06:25.234732 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-c12409c3-a387-4241-8cac-8b687dfbfdf3 tempest-VolumesNegativeTest-562038795 tempest-VolumesNegativeTest-562038795-project] Calling method '.version_select at 0x7f837d1bf4c0>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:25.289096 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.wsgi [None req-c12409c3-a387-4241-8cac-8b687dfbfdf3 tempest-VolumesNegativeTest-562038795 tempest-VolumesNegativeTest-562038795-project] HTTP exception thrown: Volume 8cd328ed-f973-4a0b-a6d4-b45bbdb9f884 could not be found. Jan 28 02:06:25.290071 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-c12409c3-a387-4241-8cac-8b687dfbfdf3 tempest-VolumesNegativeTest-562038795 tempest-VolumesNegativeTest-562038795-project] Returning 404 to user: Volume 8cd328ed-f973-4a0b-a6d4-b45bbdb9f884 could not be found. {{(pid=116374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 02:06:25.291078 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-c12409c3-a387-4241-8cac-8b687dfbfdf3 tempest-VolumesNegativeTest-562038795 tempest-VolumesNegativeTest-562038795-project] 10.222.0.79 "DELETE /compute/v2.1/os-volumes/8cd328ed-f973-4a0b-a6d4-b45bbdb9f884" status: 404 len: 109 microversion: 2.1 time: 0.063800 Jan 28 02:06:25.292268 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 28/50] 10.222.0.79 () {58 vars in 1247 bytes} [Fri Jan 28 02:06:25 2022] DELETE /compute/v2.1/os-volumes/8cd328ed-f973-4a0b-a6d4-b45bbdb9f884 => generated 109 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 28 02:06:25.305245 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-c13e1efc-4087-4109-b3de-800f8b30bc0a tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:25.306086 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-c13e1efc-4087-4109-b3de-800f8b30bc0a tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] [instance: c564cd2f-07df-4c91-9190-30cb5e9cb3ea] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:25.321491 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-c13e1efc-4087-4109-b3de-800f8b30bc0a tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:25.322094 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-c13e1efc-4087-4109-b3de-800f8b30bc0a tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:25.323081 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-c13e1efc-4087-4109-b3de-800f8b30bc0a tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:25.324455 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-c13e1efc-4087-4109-b3de-800f8b30bc0a tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:25.516607 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.network.neutron [None req-ca416e98-e5a6-4dd5-acbf-4c63ececaf89 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] validate_networks() for [('93f7fa36-86c7-4eac-8e6a-71166645bc4a', None, None, None, None, None)] {{(pid=116375) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Jan 28 02:06:25.685858 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-c13e1efc-4087-4109-b3de-800f8b30bc0a tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891908e1e9c8409ba9e91e341d08825e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22dd75c99404b48a867a48eb5d10c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:25.703770 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-c13e1efc-4087-4109-b3de-800f8b30bc0a tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] 10.222.0.79 "GET /compute/v2.1/servers/c564cd2f-07df-4c91-9190-30cb5e9cb3ea" status: 200 len: 1314 microversion: 2.1 time: 0.409582 Jan 28 02:06:25.708906 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 29/51] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:06:25 2022] GET /compute/v2.1/servers/c564cd2f-07df-4c91-9190-30cb5e9cb3ea => generated 1314 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:06:25.728364 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-72fc2f4e-a70f-4d31-b054-a34aec605e3b tempest-VolumesNegativeTest-562038795 tempest-VolumesNegativeTest-562038795-project] Calling method '.version_select at 0x7f837d1bf3a0>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:25.804123 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.wsgi [None req-72fc2f4e-a70f-4d31-b054-a34aec605e3b tempest-VolumesNegativeTest-562038795 tempest-VolumesNegativeTest-562038795-project] HTTP exception thrown: Volume 9f848e5d-0b59-4376-baee-9e369fd24277 could not be found. Jan 28 02:06:25.804893 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-72fc2f4e-a70f-4d31-b054-a34aec605e3b tempest-VolumesNegativeTest-562038795 tempest-VolumesNegativeTest-562038795-project] Returning 404 to user: Volume 9f848e5d-0b59-4376-baee-9e369fd24277 could not be found. {{(pid=116374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 02:06:25.807042 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-72fc2f4e-a70f-4d31-b054-a34aec605e3b tempest-VolumesNegativeTest-562038795 tempest-VolumesNegativeTest-562038795-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/9f848e5d-0b59-4376-baee-9e369fd24277" status: 404 len: 109 microversion: 2.1 time: 0.096866 Jan 28 02:06:25.811209 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 30/52] 10.222.0.79 () {58 vars in 1244 bytes} [Fri Jan 28 02:06:25 2022] GET /compute/v2.1/os-volumes/9f848e5d-0b59-4376-baee-9e369fd24277 => generated 109 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 02:06:25.911391 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-edc928cd-bb79-437d-a51c-a955785e7c20 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:25.918368 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-edc928cd-bb79-437d-a51c-a955785e7c20 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] [instance: 2f0bfba5-38f6-4375-a6bf-25959ad11fe0] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:25.928419 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-edc928cd-bb79-437d-a51c-a955785e7c20 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:25.928863 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-edc928cd-bb79-437d-a51c-a955785e7c20 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:25.933207 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-edc928cd-bb79-437d-a51c-a955785e7c20 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:25.933789 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-edc928cd-bb79-437d-a51c-a955785e7c20 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:26.133934 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-edc928cd-bb79-437d-a51c-a955785e7c20 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd7039b8f074a13b2030a2bb7aaff94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc19a0f9c33f47f1b504bebbb0b2c931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:26.148925 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-edc928cd-bb79-437d-a51c-a955785e7c20 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] 10.222.0.79 "GET /compute/v2.1/servers/2f0bfba5-38f6-4375-a6bf-25959ad11fe0" status: 200 len: 1273 microversion: 2.1 time: 0.241862 Jan 28 02:06:26.160494 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 31/53] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:06:25 2022] GET /compute/v2.1/servers/2f0bfba5-38f6-4375-a6bf-25959ad11fe0 => generated 1273 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:06:26.639818 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.virt.hardware [None req-ca416e98-e5a6-4dd5-acbf-4c63ececaf89 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Flavor limits 0:0:0 {{(pid=116375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 02:06:26.639818 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.virt.hardware [None req-ca416e98-e5a6-4dd5-acbf-4c63ececaf89 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Image limits 0:0:0 {{(pid=116375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 02:06:26.639818 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.virt.hardware [None req-ca416e98-e5a6-4dd5-acbf-4c63ececaf89 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Flavor pref 0:0:0 {{(pid=116375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 02:06:26.640522 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.virt.hardware [None req-ca416e98-e5a6-4dd5-acbf-4c63ececaf89 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Image pref 0:0:0 {{(pid=116375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 02:06:26.640592 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.virt.hardware [None req-ca416e98-e5a6-4dd5-acbf-4c63ececaf89 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 02:06:26.655576 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ca416e98-e5a6-4dd5-acbf-4c63ececaf89 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:26.656070 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ca416e98-e5a6-4dd5-acbf-4c63ececaf89 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:26.657414 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ca416e98-e5a6-4dd5-acbf-4c63ececaf89 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:26.657860 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ca416e98-e5a6-4dd5-acbf-4c63ececaf89 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:26.712586 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.quota [None req-ca416e98-e5a6-4dd5-acbf-4c63ececaf89 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Getting quotas for project 6bdd27e926a84fa49844fbcca271bb19. Resources: {'ram', 'cores', 'instances'} {{(pid=116375) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 02:06:26.717478 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.quota [None req-ca416e98-e5a6-4dd5-acbf-4c63ececaf89 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Getting quotas for user a6e7ef3a7fd145e5ab8726786ba318bb and project 6bdd27e926a84fa49844fbcca271bb19. Resources: {'ram', 'cores', 'instances'} {{(pid=116375) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 02:06:26.735651 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-d8f5f35d-8963-474b-b788-717f2a64fb5e tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:26.735651 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-d8f5f35d-8963-474b-b788-717f2a64fb5e tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] [instance: c564cd2f-07df-4c91-9190-30cb5e9cb3ea] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:26.736927 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-ca416e98-e5a6-4dd5-acbf-4c63ececaf89 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Going to run 1 instances... {{(pid=116375) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 02:06:26.736927 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-ca416e98-e5a6-4dd5-acbf-4c63ececaf89 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='04805ce8-b0a0-41b2-b614-bfb5b752cc5d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116375) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 02:06:26.748094 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-d8f5f35d-8963-474b-b788-717f2a64fb5e tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:26.762610 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-d8f5f35d-8963-474b-b788-717f2a64fb5e tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:26.764663 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-d8f5f35d-8963-474b-b788-717f2a64fb5e tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:26.767954 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-d8f5f35d-8963-474b-b788-717f2a64fb5e tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:27.046375 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-ca416e98-e5a6-4dd5-acbf-4c63ececaf89 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.267673 Jan 28 02:06:27.054606 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 23/54] 10.222.0.79 () {62 vars in 1187 bytes} [Fri Jan 28 02:06:24 2022] POST /compute/v2.1/servers => generated 402 bytes in 2277 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jan 28 02:06:27.073435 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-87bc6dfc-0df6-4ebf-a08e-92989014d3bb tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:27.075032 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-87bc6dfc-0df6-4ebf-a08e-92989014d3bb tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:27.508835 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-d8f5f35d-8963-474b-b788-717f2a64fb5e tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891908e1e9c8409ba9e91e341d08825e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22dd75c99404b48a867a48eb5d10c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:27.551953 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-d8f5f35d-8963-474b-b788-717f2a64fb5e tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] 10.222.0.79 "GET /compute/v2.1/servers/c564cd2f-07df-4c91-9190-30cb5e9cb3ea" status: 200 len: 1314 microversion: 2.1 time: 0.819724 Jan 28 02:06:27.557833 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 32/55] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:06:26 2022] GET /compute/v2.1/servers/c564cd2f-07df-4c91-9190-30cb5e9cb3ea => generated 1314 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:06:27.566280 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-87bc6dfc-0df6-4ebf-a08e-92989014d3bb tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:27.571899 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-4fc441f4-1fe8-4908-bc85-194fa717b523 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:27.576994 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-4fc441f4-1fe8-4908-bc85-194fa717b523 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] [instance: 2f0bfba5-38f6-4375-a6bf-25959ad11fe0] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:27.590722 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-87bc6dfc-0df6-4ebf-a08e-92989014d3bb tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:27.595656 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-87bc6dfc-0df6-4ebf-a08e-92989014d3bb tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:27.600517 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-87bc6dfc-0df6-4ebf-a08e-92989014d3bb tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84" status: 200 len: 1282 microversion: 2.20 time: 0.544572 Jan 28 02:06:27.601281 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 24/56] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:06:27 2022] GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84 => generated 1282 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:06:27.606832 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-4fc441f4-1fe8-4908-bc85-194fa717b523 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:27.611650 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-4fc441f4-1fe8-4908-bc85-194fa717b523 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:27.611650 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-4fc441f4-1fe8-4908-bc85-194fa717b523 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:27.611650 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-4fc441f4-1fe8-4908-bc85-194fa717b523 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:27.881380 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-4fc441f4-1fe8-4908-bc85-194fa717b523 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd7039b8f074a13b2030a2bb7aaff94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc19a0f9c33f47f1b504bebbb0b2c931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:27.898429 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-4fc441f4-1fe8-4908-bc85-194fa717b523 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] 10.222.0.79 "GET /compute/v2.1/servers/2f0bfba5-38f6-4375-a6bf-25959ad11fe0" status: 200 len: 1279 microversion: 2.1 time: 0.342219 Jan 28 02:06:27.899019 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 33/57] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:06:27 2022] GET /compute/v2.1/servers/2f0bfba5-38f6-4375-a6bf-25959ad11fe0 => generated 1279 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:06:28.569049 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-d0b28bbb-baa6-4f1e-b618-d1b38164aa92 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:28.570340 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-d0b28bbb-baa6-4f1e-b618-d1b38164aa92 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] [instance: c564cd2f-07df-4c91-9190-30cb5e9cb3ea] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:28.581183 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-d0b28bbb-baa6-4f1e-b618-d1b38164aa92 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:28.581898 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-d0b28bbb-baa6-4f1e-b618-d1b38164aa92 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:28.582853 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-d0b28bbb-baa6-4f1e-b618-d1b38164aa92 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:28.585086 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-d0b28bbb-baa6-4f1e-b618-d1b38164aa92 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:28.620728 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-b5669d24-4c0d-4a37-9fa0-6e8c84c424db tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:28.621350 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-b5669d24-4c0d-4a37-9fa0-6e8c84c424db tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:28.885929 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-b5669d24-4c0d-4a37-9fa0-6e8c84c424db tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:28.897144 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-b5669d24-4c0d-4a37-9fa0-6e8c84c424db tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:28.899682 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-b5669d24-4c0d-4a37-9fa0-6e8c84c424db tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:28.901492 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-b5669d24-4c0d-4a37-9fa0-6e8c84c424db tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84" status: 200 len: 1282 microversion: 2.20 time: 0.285214 Jan 28 02:06:28.902973 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 34/58] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:06:28 2022] GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84 => generated 1282 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 02:06:28.931470 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-bf52d15a-d800-49ec-9625-c832cc14f2d7 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:28.938859 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-bf52d15a-d800-49ec-9625-c832cc14f2d7 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] [instance: 2f0bfba5-38f6-4375-a6bf-25959ad11fe0] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:28.956237 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-bf52d15a-d800-49ec-9625-c832cc14f2d7 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:28.956740 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-bf52d15a-d800-49ec-9625-c832cc14f2d7 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:28.969365 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-bf52d15a-d800-49ec-9625-c832cc14f2d7 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:28.970353 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-bf52d15a-d800-49ec-9625-c832cc14f2d7 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:29.240494 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-bf52d15a-d800-49ec-9625-c832cc14f2d7 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd7039b8f074a13b2030a2bb7aaff94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc19a0f9c33f47f1b504bebbb0b2c931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:29.257572 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-bf52d15a-d800-49ec-9625-c832cc14f2d7 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] 10.222.0.79 "GET /compute/v2.1/servers/2f0bfba5-38f6-4375-a6bf-25959ad11fe0" status: 200 len: 1279 microversion: 2.1 time: 0.339076 Jan 28 02:06:29.260999 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 35/59] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:06:28 2022] GET /compute/v2.1/servers/2f0bfba5-38f6-4375-a6bf-25959ad11fe0 => generated 1279 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:06:29.386043 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [req-cf1cbaab-7f82-426b-8fdf-ca6b5d49f848 req-6bde30bc-02e0-4aa6-9d14-a599a01e2b6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec5e47ac-761b-467f-958c-516a9f8bc3e6", "tag": "333b77f2-3cf1-4c8f-94ce-5901a7eb748d"}]} {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:06:29.388761 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:06:29.388761 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: warnings.warn(msg) Jan 28 02:06:29.400230 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [req-cf1cbaab-7f82-426b-8fdf-ca6b5d49f848 req-6bde30bc-02e0-4aa6-9d14-a599a01e2b6c service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:29.400449 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [req-cf1cbaab-7f82-426b-8fdf-ca6b5d49f848 req-6bde30bc-02e0-4aa6-9d14-a599a01e2b6c service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:29.417737 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-d0b28bbb-baa6-4f1e-b618-d1b38164aa92 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891908e1e9c8409ba9e91e341d08825e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22dd75c99404b48a867a48eb5d10c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:29.435125 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-d0b28bbb-baa6-4f1e-b618-d1b38164aa92 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] 10.222.0.79 "GET /compute/v2.1/servers/c564cd2f-07df-4c91-9190-30cb5e9cb3ea" status: 200 len: 1314 microversion: 2.1 time: 0.861442 Jan 28 02:06:29.445627 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 25/60] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:06:28 2022] GET /compute/v2.1/servers/c564cd2f-07df-4c91-9190-30cb5e9cb3ea => generated 1314 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:06:29.447479 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.compute.server_external_events [req-cf1cbaab-7f82-426b-8fdf-ca6b5d49f848 req-6bde30bc-02e0-4aa6-9d14-a599a01e2b6c service nova] Creating event network-changed:333b77f2-3cf1-4c8f-94ce-5901a7eb748d for instance ec5e47ac-761b-467f-958c-516a9f8bc3e6 on hv-cinder-82497 Jan 28 02:06:29.448127 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [req-cf1cbaab-7f82-426b-8fdf-ca6b5d49f848 req-6bde30bc-02e0-4aa6-9d14-a599a01e2b6c service nova] Acquired lock "compute-rpcapi-router" {{(pid=116374) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Jan 28 02:06:29.449273 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-355464bd-2e49-4b6d-9a6d-876e01208d51 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:29.449772 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-355464bd-2e49-4b6d-9a6d-876e01208d51 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:29.450734 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-355464bd-2e49-4b6d-9a6d-876e01208d51 None None] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:29.451134 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-355464bd-2e49-4b6d-9a6d-876e01208d51 None None] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:29.461283 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.compute.rpcapi [None req-355464bd-2e49-4b6d-9a6d-876e01208d51 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Jan 28 02:06:29.462173 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-355464bd-2e49-4b6d-9a6d-876e01208d51 None None] Releasing lock "compute-rpcapi-router" {{(pid=116374) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Jan 28 02:06:29.499675 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-355464bd-2e49-4b6d-9a6d-876e01208d51 None None] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.233593 Jan 28 02:06:29.502509 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 36/61] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Jan 28 02:06:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:06:29.920227 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-55c51bd1-8944-468a-a393-6ab1b80e6806 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:29.921426 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-55c51bd1-8944-468a-a393-6ab1b80e6806 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:29.928689 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-55c51bd1-8944-468a-a393-6ab1b80e6806 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:29.928689 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-55c51bd1-8944-468a-a393-6ab1b80e6806 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:29.929240 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-55c51bd1-8944-468a-a393-6ab1b80e6806 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:29.929840 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-55c51bd1-8944-468a-a393-6ab1b80e6806 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:30.005901 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-55c51bd1-8944-468a-a393-6ab1b80e6806 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:30.014385 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-55c51bd1-8944-468a-a393-6ab1b80e6806 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:30.016585 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-55c51bd1-8944-468a-a393-6ab1b80e6806 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:30.017793 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-55c51bd1-8944-468a-a393-6ab1b80e6806 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84" status: 200 len: 1286 microversion: 2.20 time: 0.101523 Jan 28 02:06:30.018454 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 26/62] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:06:29 2022] GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84 => generated 1286 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:06:30.140572 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-5dc1cc18-874f-43b9-b70e-68e57aaf3f89 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-771988186", "imageRef": "04805ce8-b0a0-41b2-b614-bfb5b752cc5d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3b3748b7-1bed-4ab4-9fea-64d92f6154dd"}], "security_groups": [{"name": "tempest-securitygroup--1090137628"}], "key_name": "tempest-keypair-1079325533", "user_data": "}} {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:06:30.286689 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-fc99fd6d-1c66-4b61-8f4f-f33c443ff6e0 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:30.287312 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-fc99fd6d-1c66-4b61-8f4f-f33c443ff6e0 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] [instance: 2f0bfba5-38f6-4375-a6bf-25959ad11fe0] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:30.294935 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-fc99fd6d-1c66-4b61-8f4f-f33c443ff6e0 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:30.295384 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-fc99fd6d-1c66-4b61-8f4f-f33c443ff6e0 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:30.296731 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-fc99fd6d-1c66-4b61-8f4f-f33c443ff6e0 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:30.297733 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-fc99fd6d-1c66-4b61-8f4f-f33c443ff6e0 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:30.302931 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.network.neutron [None req-5dc1cc18-874f-43b9-b70e-68e57aaf3f89 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] validate_networks() for [('3b3748b7-1bed-4ab4-9fea-64d92f6154dd', None, None, None, None, None)] {{(pid=116374) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Jan 28 02:06:30.624663 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-fc99fd6d-1c66-4b61-8f4f-f33c443ff6e0 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd7039b8f074a13b2030a2bb7aaff94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc19a0f9c33f47f1b504bebbb0b2c931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:30.632927 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-fc99fd6d-1c66-4b61-8f4f-f33c443ff6e0 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] 10.222.0.79 "GET /compute/v2.1/servers/2f0bfba5-38f6-4375-a6bf-25959ad11fe0" status: 200 len: 1321 microversion: 2.1 time: 0.358703 Jan 28 02:06:30.633501 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 27/63] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:06:30 2022] GET /compute/v2.1/servers/2f0bfba5-38f6-4375-a6bf-25959ad11fe0 => generated 1321 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:06:30.637778 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-121dca62-3e59-487b-9d77-889cbe8c5787 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:30.638415 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-121dca62-3e59-487b-9d77-889cbe8c5787 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] [instance: c564cd2f-07df-4c91-9190-30cb5e9cb3ea] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:30.645121 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-121dca62-3e59-487b-9d77-889cbe8c5787 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:30.645566 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-121dca62-3e59-487b-9d77-889cbe8c5787 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:30.646712 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-121dca62-3e59-487b-9d77-889cbe8c5787 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:30.647294 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-121dca62-3e59-487b-9d77-889cbe8c5787 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:30.989679 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-121dca62-3e59-487b-9d77-889cbe8c5787 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891908e1e9c8409ba9e91e341d08825e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22dd75c99404b48a867a48eb5d10c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:30.998121 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-121dca62-3e59-487b-9d77-889cbe8c5787 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] 10.222.0.79 "GET /compute/v2.1/servers/c564cd2f-07df-4c91-9190-30cb5e9cb3ea" status: 200 len: 1314 microversion: 2.1 time: 0.363575 Jan 28 02:06:30.998706 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 28/64] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:06:30 2022] GET /compute/v2.1/servers/c564cd2f-07df-4c91-9190-30cb5e9cb3ea => generated 1314 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:06:31.037119 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-59c7d2cf-a5b0-4916-92b0-38da0c449082 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:31.041377 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-59c7d2cf-a5b0-4916-92b0-38da0c449082 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:31.046010 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-59c7d2cf-a5b0-4916-92b0-38da0c449082 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:31.047204 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-59c7d2cf-a5b0-4916-92b0-38da0c449082 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:31.049008 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-59c7d2cf-a5b0-4916-92b0-38da0c449082 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:31.049603 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-59c7d2cf-a5b0-4916-92b0-38da0c449082 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:31.298100 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-59c7d2cf-a5b0-4916-92b0-38da0c449082 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:31.307455 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-59c7d2cf-a5b0-4916-92b0-38da0c449082 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:31.309503 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-59c7d2cf-a5b0-4916-92b0-38da0c449082 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:31.311950 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-59c7d2cf-a5b0-4916-92b0-38da0c449082 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84" status: 200 len: 1334 microversion: 2.20 time: 0.278497 Jan 28 02:06:31.313321 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 29/65] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:06:31 2022] GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84 => generated 1334 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 02:06:31.417360 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.virt.hardware [None req-5dc1cc18-874f-43b9-b70e-68e57aaf3f89 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Flavor limits 0:0:0 {{(pid=116374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 02:06:31.418256 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.virt.hardware [None req-5dc1cc18-874f-43b9-b70e-68e57aaf3f89 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Image limits 0:0:0 {{(pid=116374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 02:06:31.418973 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.virt.hardware [None req-5dc1cc18-874f-43b9-b70e-68e57aaf3f89 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Flavor pref 0:0:0 {{(pid=116374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 02:06:31.419895 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.virt.hardware [None req-5dc1cc18-874f-43b9-b70e-68e57aaf3f89 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Image pref 0:0:0 {{(pid=116374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 02:06:31.420386 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.virt.hardware [None req-5dc1cc18-874f-43b9-b70e-68e57aaf3f89 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 02:06:31.439005 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-5dc1cc18-874f-43b9-b70e-68e57aaf3f89 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:31.439474 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-5dc1cc18-874f-43b9-b70e-68e57aaf3f89 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:31.442374 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-5dc1cc18-874f-43b9-b70e-68e57aaf3f89 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:31.443016 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-5dc1cc18-874f-43b9-b70e-68e57aaf3f89 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:31.466710 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.quota [None req-5dc1cc18-874f-43b9-b70e-68e57aaf3f89 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Getting quotas for project 0abe012ba65845329098e0e06c54b9c1. Resources: {'ram', 'cores', 'instances'} {{(pid=116374) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 02:06:31.473037 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.quota [None req-5dc1cc18-874f-43b9-b70e-68e57aaf3f89 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Getting quotas for user acab2a0c4a0e48909317791a3de85b53 and project 0abe012ba65845329098e0e06c54b9c1. Resources: {'ram', 'cores', 'instances'} {{(pid=116374) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 02:06:31.487333 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-5dc1cc18-874f-43b9-b70e-68e57aaf3f89 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Going to run 1 instances... {{(pid=116374) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 02:06:31.491856 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-5dc1cc18-874f-43b9-b70e-68e57aaf3f89 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: d5f49055-da38-486c-9f10-1658c64d46f5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='04805ce8-b0a0-41b2-b614-bfb5b752cc5d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116374) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 02:06:31.649966 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-561acb47-c0f7-42b1-b540-5dc08c6fe67a tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:31.650663 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-561acb47-c0f7-42b1-b540-5dc08c6fe67a tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] [instance: 2f0bfba5-38f6-4375-a6bf-25959ad11fe0] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:31.657023 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-561acb47-c0f7-42b1-b540-5dc08c6fe67a tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:31.657783 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-561acb47-c0f7-42b1-b540-5dc08c6fe67a tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:31.658855 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-561acb47-c0f7-42b1-b540-5dc08c6fe67a tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:31.659456 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-561acb47-c0f7-42b1-b540-5dc08c6fe67a tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:31.727197 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-5dc1cc18-874f-43b9-b70e-68e57aaf3f89 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.592206 Jan 28 02:06:31.737763 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 37/66] 10.222.0.79 () {60 vars in 1146 bytes} [Fri Jan 28 02:06:30 2022] POST /compute/v2.1/servers => generated 402 bytes in 1603 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 28 02:06:31.755889 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-b5b50ec1-2f31-44fb-a181-a43fc39002cf tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:31.756754 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-b5b50ec1-2f31-44fb-a181-a43fc39002cf tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: d5f49055-da38-486c-9f10-1658c64d46f5] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:31.850921 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-b5b50ec1-2f31-44fb-a181-a43fc39002cf tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acab2a0c4a0e48909317791a3de85b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abe012ba65845329098e0e06c54b9c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:31.875319 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-b5b50ec1-2f31-44fb-a181-a43fc39002cf tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "GET /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5" status: 200 len: 1237 microversion: 2.1 time: 0.136285 Jan 28 02:06:31.877149 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 38/67] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:06:31 2022] GET /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5 => generated 1237 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:06:31.947164 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-561acb47-c0f7-42b1-b540-5dc08c6fe67a tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd7039b8f074a13b2030a2bb7aaff94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc19a0f9c33f47f1b504bebbb0b2c931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:31.960897 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-561acb47-c0f7-42b1-b540-5dc08c6fe67a tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] 10.222.0.79 "GET /compute/v2.1/servers/2f0bfba5-38f6-4375-a6bf-25959ad11fe0" status: 200 len: 1321 microversion: 2.1 time: 0.313989 Jan 28 02:06:31.966233 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 30/68] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:06:31 2022] GET /compute/v2.1/servers/2f0bfba5-38f6-4375-a6bf-25959ad11fe0 => generated 1321 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:06:32.015698 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-b48ca788-55b6-4ce4-89b5-ed125009ff87 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:32.016891 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-b48ca788-55b6-4ce4-89b5-ed125009ff87 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] [instance: c564cd2f-07df-4c91-9190-30cb5e9cb3ea] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:32.023672 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-b48ca788-55b6-4ce4-89b5-ed125009ff87 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:32.024147 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-b48ca788-55b6-4ce4-89b5-ed125009ff87 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:32.024931 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-b48ca788-55b6-4ce4-89b5-ed125009ff87 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:32.025356 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-b48ca788-55b6-4ce4-89b5-ed125009ff87 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:32.213301 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [req-ee362cc4-e840-4cd8-902b-32d9fe3720d7 req-eb03cf09-d48a-4855-b78f-c3981ca78d4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f0bfba5-38f6-4375-a6bf-25959ad11fe0", "tag": "f563e565-6b72-491c-a99c-3004a4f17f98"}]} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:06:32.215394 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:06:32.215394 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: warnings.warn(msg) Jan 28 02:06:32.224316 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-ee362cc4-e840-4cd8-902b-32d9fe3720d7 req-eb03cf09-d48a-4855-b78f-c3981ca78d4f service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:32.225056 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-ee362cc4-e840-4cd8-902b-32d9fe3720d7 req-eb03cf09-d48a-4855-b78f-c3981ca78d4f service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:32.246198 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.compute.server_external_events [req-ee362cc4-e840-4cd8-902b-32d9fe3720d7 req-eb03cf09-d48a-4855-b78f-c3981ca78d4f service nova] Creating event network-changed:f563e565-6b72-491c-a99c-3004a4f17f98 for instance 2f0bfba5-38f6-4375-a6bf-25959ad11fe0 on hv-cinder-82497 Jan 28 02:06:32.252921 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [req-ee362cc4-e840-4cd8-902b-32d9fe3720d7 req-eb03cf09-d48a-4855-b78f-c3981ca78d4f service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043155 Jan 28 02:06:32.253828 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 31/69] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Jan 28 02:06:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:06:32.278278 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-b48ca788-55b6-4ce4-89b5-ed125009ff87 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891908e1e9c8409ba9e91e341d08825e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22dd75c99404b48a867a48eb5d10c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:32.313649 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-b48ca788-55b6-4ce4-89b5-ed125009ff87 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] 10.222.0.79 "GET /compute/v2.1/servers/c564cd2f-07df-4c91-9190-30cb5e9cb3ea" status: 200 len: 1314 microversion: 2.1 time: 0.301413 Jan 28 02:06:32.314239 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 39/70] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:06:32 2022] GET /compute/v2.1/servers/c564cd2f-07df-4c91-9190-30cb5e9cb3ea => generated 1314 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:06:32.339882 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-b53e9865-58e5-4b80-8aba-35bbfa78e71d tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:32.346318 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-b53e9865-58e5-4b80-8aba-35bbfa78e71d tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:32.356551 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b53e9865-58e5-4b80-8aba-35bbfa78e71d tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:32.357216 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b53e9865-58e5-4b80-8aba-35bbfa78e71d tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:32.358092 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b53e9865-58e5-4b80-8aba-35bbfa78e71d tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:32.358834 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b53e9865-58e5-4b80-8aba-35bbfa78e71d tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:32.522377 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-b53e9865-58e5-4b80-8aba-35bbfa78e71d tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:32.530745 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-b53e9865-58e5-4b80-8aba-35bbfa78e71d tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:32.541357 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-b53e9865-58e5-4b80-8aba-35bbfa78e71d tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:32.541357 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-b53e9865-58e5-4b80-8aba-35bbfa78e71d tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84" status: 200 len: 1340 microversion: 2.20 time: 0.207656 Jan 28 02:06:32.541357 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 32/71] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:06:32 2022] GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84 => generated 1340 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 02:06:32.896842 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-e53c8024-d421-4a3f-aa16-7bbee7459629 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:32.898451 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-e53c8024-d421-4a3f-aa16-7bbee7459629 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: d5f49055-da38-486c-9f10-1658c64d46f5] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:32.983357 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-7d7d11ee-3e59-4be1-bb66-bb74311c7d36 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:32.984336 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-7d7d11ee-3e59-4be1-bb66-bb74311c7d36 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] [instance: 2f0bfba5-38f6-4375-a6bf-25959ad11fe0] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:32.996263 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-e53c8024-d421-4a3f-aa16-7bbee7459629 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acab2a0c4a0e48909317791a3de85b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abe012ba65845329098e0e06c54b9c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:33.006432 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-e53c8024-d421-4a3f-aa16-7bbee7459629 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "GET /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5" status: 200 len: 1237 microversion: 2.1 time: 0.115520 Jan 28 02:06:33.006744 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-7d7d11ee-3e59-4be1-bb66-bb74311c7d36 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:33.007898 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-7d7d11ee-3e59-4be1-bb66-bb74311c7d36 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:33.010234 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-7d7d11ee-3e59-4be1-bb66-bb74311c7d36 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:33.012796 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-7d7d11ee-3e59-4be1-bb66-bb74311c7d36 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:33.019289 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 40/72] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:06:32 2022] GET /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5 => generated 1237 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:06:33.295051 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-7d7d11ee-3e59-4be1-bb66-bb74311c7d36 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd7039b8f074a13b2030a2bb7aaff94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc19a0f9c33f47f1b504bebbb0b2c931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:33.303073 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-7d7d11ee-3e59-4be1-bb66-bb74311c7d36 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] 10.222.0.79 "GET /compute/v2.1/servers/2f0bfba5-38f6-4375-a6bf-25959ad11fe0" status: 200 len: 1321 microversion: 2.1 time: 0.323552 Jan 28 02:06:33.312909 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 33/73] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:06:32 2022] GET /compute/v2.1/servers/2f0bfba5-38f6-4375-a6bf-25959ad11fe0 => generated 1321 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:06:33.330646 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-3ca91ae2-b9c8-471e-ae48-fa1b447c5a01 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:33.331490 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-3ca91ae2-b9c8-471e-ae48-fa1b447c5a01 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] [instance: c564cd2f-07df-4c91-9190-30cb5e9cb3ea] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:33.338709 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-3ca91ae2-b9c8-471e-ae48-fa1b447c5a01 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:33.339728 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-3ca91ae2-b9c8-471e-ae48-fa1b447c5a01 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:33.340756 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-3ca91ae2-b9c8-471e-ae48-fa1b447c5a01 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:33.341624 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-3ca91ae2-b9c8-471e-ae48-fa1b447c5a01 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:33.556950 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-062e9fc0-bbf0-457b-b0e1-1351b437319c tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:33.557565 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-062e9fc0-bbf0-457b-b0e1-1351b437319c tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:33.565632 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-062e9fc0-bbf0-457b-b0e1-1351b437319c tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:33.566092 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-062e9fc0-bbf0-457b-b0e1-1351b437319c tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:33.566870 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-062e9fc0-bbf0-457b-b0e1-1351b437319c tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:33.569438 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-062e9fc0-bbf0-457b-b0e1-1351b437319c tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:33.615734 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-3ca91ae2-b9c8-471e-ae48-fa1b447c5a01 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891908e1e9c8409ba9e91e341d08825e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22dd75c99404b48a867a48eb5d10c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:33.624456 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-3ca91ae2-b9c8-471e-ae48-fa1b447c5a01 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] 10.222.0.79 "GET /compute/v2.1/servers/c564cd2f-07df-4c91-9190-30cb5e9cb3ea" status: 200 len: 1314 microversion: 2.1 time: 0.296762 Jan 28 02:06:33.625453 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 41/74] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:06:33 2022] GET /compute/v2.1/servers/c564cd2f-07df-4c91-9190-30cb5e9cb3ea => generated 1314 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:06:33.748490 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-062e9fc0-bbf0-457b-b0e1-1351b437319c tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:33.762311 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-062e9fc0-bbf0-457b-b0e1-1351b437319c tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:33.762311 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-062e9fc0-bbf0-457b-b0e1-1351b437319c tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:33.762932 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-062e9fc0-bbf0-457b-b0e1-1351b437319c tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84" status: 200 len: 1408 microversion: 2.20 time: 0.210049 Jan 28 02:06:33.763811 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 34/75] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:06:33 2022] GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84 => generated 1408 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 02:06:34.023804 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-6aa48edf-1155-4769-b6b8-bfe95155f7b1 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:34.024528 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-6aa48edf-1155-4769-b6b8-bfe95155f7b1 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: d5f49055-da38-486c-9f10-1658c64d46f5] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:34.049064 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-6aa48edf-1155-4769-b6b8-bfe95155f7b1 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:34.050866 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-6aa48edf-1155-4769-b6b8-bfe95155f7b1 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:34.053828 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-6aa48edf-1155-4769-b6b8-bfe95155f7b1 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:34.056474 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-6aa48edf-1155-4769-b6b8-bfe95155f7b1 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:34.095478 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [req-9e310a84-892c-44c6-815a-7934a0aca928 req-778c47ec-9614-4575-8704-9128fddf740b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f25403b-0399-48d0-86a9-6e5022287c84", "tag": "eb8f729a-b66f-4c5c-a62e-472c346922bb"}]} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:06:34.097906 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:06:34.097906 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: warnings.warn(msg) Jan 28 02:06:34.113722 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-9e310a84-892c-44c6-815a-7934a0aca928 req-778c47ec-9614-4575-8704-9128fddf740b service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:34.114839 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-9e310a84-892c-44c6-815a-7934a0aca928 req-778c47ec-9614-4575-8704-9128fddf740b service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:34.139013 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.compute.server_external_events [req-9e310a84-892c-44c6-815a-7934a0aca928 req-778c47ec-9614-4575-8704-9128fddf740b service nova] Creating event network-changed:eb8f729a-b66f-4c5c-a62e-472c346922bb for instance 4f25403b-0399-48d0-86a9-6e5022287c84 on hv-cinder-82497 Jan 28 02:06:34.145969 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [req-9e310a84-892c-44c6-815a-7934a0aca928 req-778c47ec-9614-4575-8704-9128fddf740b service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054923 Jan 28 02:06:34.153423 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 35/76] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Jan 28 02:06:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:06:34.168119 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-6aa48edf-1155-4769-b6b8-bfe95155f7b1 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acab2a0c4a0e48909317791a3de85b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abe012ba65845329098e0e06c54b9c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:34.177043 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-6aa48edf-1155-4769-b6b8-bfe95155f7b1 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "GET /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5" status: 200 len: 1233 microversion: 2.1 time: 0.156873 Jan 28 02:06:34.186929 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 42/77] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:06:34 2022] GET /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5 => generated 1233 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:06:34.320591 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-0315c1cc-1d05-43a6-853f-58f05d86e59d tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:34.324110 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-0315c1cc-1d05-43a6-853f-58f05d86e59d tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] [instance: 2f0bfba5-38f6-4375-a6bf-25959ad11fe0] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:34.328878 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-0315c1cc-1d05-43a6-853f-58f05d86e59d tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:34.329847 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-0315c1cc-1d05-43a6-853f-58f05d86e59d tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:34.330691 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-0315c1cc-1d05-43a6-853f-58f05d86e59d tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:34.331242 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-0315c1cc-1d05-43a6-853f-58f05d86e59d tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:34.473379 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-0315c1cc-1d05-43a6-853f-58f05d86e59d tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd7039b8f074a13b2030a2bb7aaff94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc19a0f9c33f47f1b504bebbb0b2c931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:34.480542 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-0315c1cc-1d05-43a6-853f-58f05d86e59d tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] 10.222.0.79 "GET /compute/v2.1/servers/2f0bfba5-38f6-4375-a6bf-25959ad11fe0" status: 200 len: 1321 microversion: 2.1 time: 0.163981 Jan 28 02:06:34.481101 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 36/78] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:06:34 2022] GET /compute/v2.1/servers/2f0bfba5-38f6-4375-a6bf-25959ad11fe0 => generated 1321 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:06:34.641698 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-f8d6d17c-bdf9-4674-900f-ba54f6296fc9 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:34.642975 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-f8d6d17c-bdf9-4674-900f-ba54f6296fc9 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] [instance: c564cd2f-07df-4c91-9190-30cb5e9cb3ea] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:34.648415 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-f8d6d17c-bdf9-4674-900f-ba54f6296fc9 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:34.649083 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-f8d6d17c-bdf9-4674-900f-ba54f6296fc9 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:34.649842 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-f8d6d17c-bdf9-4674-900f-ba54f6296fc9 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:34.650546 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-f8d6d17c-bdf9-4674-900f-ba54f6296fc9 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:34.783033 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-71e6feb8-6ffd-4792-a18b-d99216808911 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:34.783661 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-71e6feb8-6ffd-4792-a18b-d99216808911 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:34.797945 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-71e6feb8-6ffd-4792-a18b-d99216808911 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:34.800577 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-71e6feb8-6ffd-4792-a18b-d99216808911 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:34.802916 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-71e6feb8-6ffd-4792-a18b-d99216808911 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:34.803522 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-71e6feb8-6ffd-4792-a18b-d99216808911 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:34.852560 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-f8d6d17c-bdf9-4674-900f-ba54f6296fc9 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891908e1e9c8409ba9e91e341d08825e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22dd75c99404b48a867a48eb5d10c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:34.860857 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-f8d6d17c-bdf9-4674-900f-ba54f6296fc9 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] 10.222.0.79 "GET /compute/v2.1/servers/c564cd2f-07df-4c91-9190-30cb5e9cb3ea" status: 200 len: 1314 microversion: 2.1 time: 0.223072 Jan 28 02:06:34.864367 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 43/79] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:06:34 2022] GET /compute/v2.1/servers/c564cd2f-07df-4c91-9190-30cb5e9cb3ea => generated 1314 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:06:34.967561 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-71e6feb8-6ffd-4792-a18b-d99216808911 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:34.981343 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-71e6feb8-6ffd-4792-a18b-d99216808911 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:34.983148 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-71e6feb8-6ffd-4792-a18b-d99216808911 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:34.984469 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-71e6feb8-6ffd-4792-a18b-d99216808911 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84" status: 200 len: 1408 microversion: 2.20 time: 0.206340 Jan 28 02:06:34.986723 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 37/80] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:06:34 2022] GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84 => generated 1408 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 02:06:35.196146 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-0682e6b2-3a09-4ae7-8aa2-07a5fdbd2e14 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:35.196790 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-0682e6b2-3a09-4ae7-8aa2-07a5fdbd2e14 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: d5f49055-da38-486c-9f10-1658c64d46f5] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:35.204665 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-0682e6b2-3a09-4ae7-8aa2-07a5fdbd2e14 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:35.205330 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-0682e6b2-3a09-4ae7-8aa2-07a5fdbd2e14 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:35.206272 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-0682e6b2-3a09-4ae7-8aa2-07a5fdbd2e14 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:35.206705 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-0682e6b2-3a09-4ae7-8aa2-07a5fdbd2e14 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:35.273707 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-0682e6b2-3a09-4ae7-8aa2-07a5fdbd2e14 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acab2a0c4a0e48909317791a3de85b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abe012ba65845329098e0e06c54b9c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:35.281189 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-0682e6b2-3a09-4ae7-8aa2-07a5fdbd2e14 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "GET /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5" status: 200 len: 1297 microversion: 2.1 time: 0.089724 Jan 28 02:06:35.286806 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 44/81] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:06:35 2022] GET /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5 => generated 1297 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:06:35.496768 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-a3d163cd-3ae5-4ef1-8996-76485209b8e6 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:35.497304 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-a3d163cd-3ae5-4ef1-8996-76485209b8e6 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] [instance: 2f0bfba5-38f6-4375-a6bf-25959ad11fe0] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:35.503630 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a3d163cd-3ae5-4ef1-8996-76485209b8e6 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:35.504116 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a3d163cd-3ae5-4ef1-8996-76485209b8e6 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:35.504893 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a3d163cd-3ae5-4ef1-8996-76485209b8e6 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:35.505331 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a3d163cd-3ae5-4ef1-8996-76485209b8e6 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:35.631797 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-a3d163cd-3ae5-4ef1-8996-76485209b8e6 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd7039b8f074a13b2030a2bb7aaff94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc19a0f9c33f47f1b504bebbb0b2c931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:35.641461 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-a3d163cd-3ae5-4ef1-8996-76485209b8e6 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] 10.222.0.79 "GET /compute/v2.1/servers/2f0bfba5-38f6-4375-a6bf-25959ad11fe0" status: 200 len: 1321 microversion: 2.1 time: 0.148129 Jan 28 02:06:35.642673 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 38/82] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:06:35 2022] GET /compute/v2.1/servers/2f0bfba5-38f6-4375-a6bf-25959ad11fe0 => generated 1321 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:06:35.880258 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-2d0cd3bf-ef8b-4937-9b16-77d06c4429e1 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:35.880258 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-2d0cd3bf-ef8b-4937-9b16-77d06c4429e1 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] [instance: c564cd2f-07df-4c91-9190-30cb5e9cb3ea] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:35.885581 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-2d0cd3bf-ef8b-4937-9b16-77d06c4429e1 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:35.886295 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-2d0cd3bf-ef8b-4937-9b16-77d06c4429e1 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:35.887078 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-2d0cd3bf-ef8b-4937-9b16-77d06c4429e1 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:35.887702 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-2d0cd3bf-ef8b-4937-9b16-77d06c4429e1 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:36.010430 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-1cb4e681-b0b9-4365-95e6-5ce82f0eeb3d tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:36.011039 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-1cb4e681-b0b9-4365-95e6-5ce82f0eeb3d tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:36.017696 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-1cb4e681-b0b9-4365-95e6-5ce82f0eeb3d tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:36.022527 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-1cb4e681-b0b9-4365-95e6-5ce82f0eeb3d tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:36.022527 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-1cb4e681-b0b9-4365-95e6-5ce82f0eeb3d tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:36.022527 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-1cb4e681-b0b9-4365-95e6-5ce82f0eeb3d tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:36.023082 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-2d0cd3bf-ef8b-4937-9b16-77d06c4429e1 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891908e1e9c8409ba9e91e341d08825e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22dd75c99404b48a867a48eb5d10c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:36.029367 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-2d0cd3bf-ef8b-4937-9b16-77d06c4429e1 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] 10.222.0.79 "GET /compute/v2.1/servers/c564cd2f-07df-4c91-9190-30cb5e9cb3ea" status: 200 len: 1314 microversion: 2.1 time: 0.153727 Jan 28 02:06:36.029961 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 45/83] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:06:35 2022] GET /compute/v2.1/servers/c564cd2f-07df-4c91-9190-30cb5e9cb3ea => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:06:36.142852 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-1cb4e681-b0b9-4365-95e6-5ce82f0eeb3d tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:36.150978 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-1cb4e681-b0b9-4365-95e6-5ce82f0eeb3d tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:36.153510 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-1cb4e681-b0b9-4365-95e6-5ce82f0eeb3d tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:36.153721 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-1cb4e681-b0b9-4365-95e6-5ce82f0eeb3d tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84" status: 200 len: 1408 microversion: 2.20 time: 0.146948 Jan 28 02:06:36.154209 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 39/84] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:06:36 2022] GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84 => generated 1408 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 02:06:36.298476 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-1a4788f7-99f6-4096-9a29-58d76a16e989 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:36.299059 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-1a4788f7-99f6-4096-9a29-58d76a16e989 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: d5f49055-da38-486c-9f10-1658c64d46f5] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:36.305350 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-1a4788f7-99f6-4096-9a29-58d76a16e989 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:36.307102 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-1a4788f7-99f6-4096-9a29-58d76a16e989 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:36.307102 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-1a4788f7-99f6-4096-9a29-58d76a16e989 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:36.307102 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-1a4788f7-99f6-4096-9a29-58d76a16e989 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:36.380943 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-1a4788f7-99f6-4096-9a29-58d76a16e989 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acab2a0c4a0e48909317791a3de85b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abe012ba65845329098e0e06c54b9c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:36.388386 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-1a4788f7-99f6-4096-9a29-58d76a16e989 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "GET /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5" status: 200 len: 1297 microversion: 2.1 time: 0.093750 Jan 28 02:06:36.388949 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 46/85] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:06:36 2022] GET /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5 => generated 1297 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:06:36.659027 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-9000dd02-0028-48d3-b90c-507e2f431c19 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:36.659661 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-9000dd02-0028-48d3-b90c-507e2f431c19 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] [instance: 2f0bfba5-38f6-4375-a6bf-25959ad11fe0] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:36.665956 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-9000dd02-0028-48d3-b90c-507e2f431c19 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:36.666428 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-9000dd02-0028-48d3-b90c-507e2f431c19 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:36.667200 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-9000dd02-0028-48d3-b90c-507e2f431c19 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:36.667781 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-9000dd02-0028-48d3-b90c-507e2f431c19 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:36.795364 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-9000dd02-0028-48d3-b90c-507e2f431c19 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd7039b8f074a13b2030a2bb7aaff94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc19a0f9c33f47f1b504bebbb0b2c931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:36.803271 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-9000dd02-0028-48d3-b90c-507e2f431c19 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] 10.222.0.79 "GET /compute/v2.1/servers/2f0bfba5-38f6-4375-a6bf-25959ad11fe0" status: 200 len: 1321 microversion: 2.1 time: 0.148742 Jan 28 02:06:36.803833 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 40/86] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:06:36 2022] GET /compute/v2.1/servers/2f0bfba5-38f6-4375-a6bf-25959ad11fe0 => generated 1321 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:06:37.047033 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-a7fb3098-32ce-4393-85b2-a1cadaa87bc7 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:37.057058 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-a7fb3098-32ce-4393-85b2-a1cadaa87bc7 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] [instance: c564cd2f-07df-4c91-9190-30cb5e9cb3ea] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:37.057058 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-a7fb3098-32ce-4393-85b2-a1cadaa87bc7 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:37.057058 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-a7fb3098-32ce-4393-85b2-a1cadaa87bc7 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:37.057058 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-a7fb3098-32ce-4393-85b2-a1cadaa87bc7 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:37.057405 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-a7fb3098-32ce-4393-85b2-a1cadaa87bc7 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:37.175196 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-9bb0d762-0bdb-4104-8260-447eff0e9c89 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:37.175959 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-9bb0d762-0bdb-4104-8260-447eff0e9c89 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:37.183068 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-9bb0d762-0bdb-4104-8260-447eff0e9c89 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:37.183905 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-9bb0d762-0bdb-4104-8260-447eff0e9c89 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:37.184732 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-9bb0d762-0bdb-4104-8260-447eff0e9c89 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:37.185158 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-9bb0d762-0bdb-4104-8260-447eff0e9c89 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:37.410474 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-a7fb3098-32ce-4393-85b2-a1cadaa87bc7 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891908e1e9c8409ba9e91e341d08825e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22dd75c99404b48a867a48eb5d10c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:37.418239 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-a7fb3098-32ce-4393-85b2-a1cadaa87bc7 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] 10.222.0.79 "GET /compute/v2.1/servers/c564cd2f-07df-4c91-9190-30cb5e9cb3ea" status: 200 len: 1314 microversion: 2.1 time: 0.374662 Jan 28 02:06:37.425737 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 47/87] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:06:37 2022] GET /compute/v2.1/servers/c564cd2f-07df-4c91-9190-30cb5e9cb3ea => generated 1314 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:06:37.429403 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-7338c123-a1c7-4331-8fe1-8e256d38d413 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:37.430010 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-7338c123-a1c7-4331-8fe1-8e256d38d413 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: d5f49055-da38-486c-9f10-1658c64d46f5] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:37.436819 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-7338c123-a1c7-4331-8fe1-8e256d38d413 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:37.437270 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-7338c123-a1c7-4331-8fe1-8e256d38d413 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:37.437401 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-9bb0d762-0bdb-4104-8260-447eff0e9c89 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:37.438192 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-7338c123-a1c7-4331-8fe1-8e256d38d413 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:37.438630 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-7338c123-a1c7-4331-8fe1-8e256d38d413 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:37.445647 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-9bb0d762-0bdb-4104-8260-447eff0e9c89 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:37.446760 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-9bb0d762-0bdb-4104-8260-447eff0e9c89 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:37.447918 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-9bb0d762-0bdb-4104-8260-447eff0e9c89 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84" status: 200 len: 1408 microversion: 2.20 time: 0.278872 Jan 28 02:06:37.448688 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 41/88] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:06:37 2022] GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84 => generated 1408 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:06:37.499868 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-7338c123-a1c7-4331-8fe1-8e256d38d413 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acab2a0c4a0e48909317791a3de85b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abe012ba65845329098e0e06c54b9c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:37.508119 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-7338c123-a1c7-4331-8fe1-8e256d38d413 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "GET /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5" status: 200 len: 1297 microversion: 2.1 time: 0.088163 Jan 28 02:06:37.508674 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 48/89] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:06:37 2022] GET /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5 => generated 1297 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:06:37.819673 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-240a6a20-67a8-446a-bde6-9fe59d6ae06c tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:37.825211 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-240a6a20-67a8-446a-bde6-9fe59d6ae06c tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] [instance: 2f0bfba5-38f6-4375-a6bf-25959ad11fe0] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:37.826051 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-240a6a20-67a8-446a-bde6-9fe59d6ae06c tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:37.826492 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-240a6a20-67a8-446a-bde6-9fe59d6ae06c tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:37.827363 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-240a6a20-67a8-446a-bde6-9fe59d6ae06c tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:37.827787 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-240a6a20-67a8-446a-bde6-9fe59d6ae06c tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:38.099943 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-240a6a20-67a8-446a-bde6-9fe59d6ae06c tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd7039b8f074a13b2030a2bb7aaff94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc19a0f9c33f47f1b504bebbb0b2c931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:38.110477 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-240a6a20-67a8-446a-bde6-9fe59d6ae06c tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] 10.222.0.79 "GET /compute/v2.1/servers/2f0bfba5-38f6-4375-a6bf-25959ad11fe0" status: 200 len: 1321 microversion: 2.1 time: 0.294096 Jan 28 02:06:38.120481 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 42/90] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:06:37 2022] GET /compute/v2.1/servers/2f0bfba5-38f6-4375-a6bf-25959ad11fe0 => generated 1321 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:06:38.435131 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-19b0b4c5-43cd-49b4-9f95-eef6bfff81d8 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:38.436643 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-19b0b4c5-43cd-49b4-9f95-eef6bfff81d8 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] [instance: c564cd2f-07df-4c91-9190-30cb5e9cb3ea] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:38.445005 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-19b0b4c5-43cd-49b4-9f95-eef6bfff81d8 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:38.445577 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-19b0b4c5-43cd-49b4-9f95-eef6bfff81d8 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:38.446573 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-19b0b4c5-43cd-49b4-9f95-eef6bfff81d8 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:38.447491 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-19b0b4c5-43cd-49b4-9f95-eef6bfff81d8 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:38.466956 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-ad702211-e8a1-48d8-a22f-10e63707488a tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:38.467766 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-ad702211-e8a1-48d8-a22f-10e63707488a tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:38.476062 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ad702211-e8a1-48d8-a22f-10e63707488a tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:38.480551 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ad702211-e8a1-48d8-a22f-10e63707488a tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:38.481507 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ad702211-e8a1-48d8-a22f-10e63707488a tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:38.482259 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ad702211-e8a1-48d8-a22f-10e63707488a tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:38.685242 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-19b0b4c5-43cd-49b4-9f95-eef6bfff81d8 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891908e1e9c8409ba9e91e341d08825e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22dd75c99404b48a867a48eb5d10c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:38.694029 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-19b0b4c5-43cd-49b4-9f95-eef6bfff81d8 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] 10.222.0.79 "GET /compute/v2.1/servers/c564cd2f-07df-4c91-9190-30cb5e9cb3ea" status: 200 len: 1314 microversion: 2.1 time: 0.262812 Jan 28 02:06:38.694986 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 49/91] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:06:38 2022] GET /compute/v2.1/servers/c564cd2f-07df-4c91-9190-30cb5e9cb3ea => generated 1314 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:06:38.699776 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-dfb51665-42b9-4d94-b7f1-4358f7f46320 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:38.700767 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-dfb51665-42b9-4d94-b7f1-4358f7f46320 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: d5f49055-da38-486c-9f10-1658c64d46f5] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:38.704371 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-ad702211-e8a1-48d8-a22f-10e63707488a tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:38.708147 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-dfb51665-42b9-4d94-b7f1-4358f7f46320 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:38.708601 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-dfb51665-42b9-4d94-b7f1-4358f7f46320 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:38.709419 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-dfb51665-42b9-4d94-b7f1-4358f7f46320 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:38.710063 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-dfb51665-42b9-4d94-b7f1-4358f7f46320 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:38.718589 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-ad702211-e8a1-48d8-a22f-10e63707488a tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:38.735991 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-ad702211-e8a1-48d8-a22f-10e63707488a tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:38.735991 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-ad702211-e8a1-48d8-a22f-10e63707488a tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84" status: 200 len: 1408 microversion: 2.20 time: 0.259654 Jan 28 02:06:38.735991 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 43/92] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:06:38 2022] GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84 => generated 1408 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 02:06:38.919250 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-dfb51665-42b9-4d94-b7f1-4358f7f46320 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acab2a0c4a0e48909317791a3de85b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abe012ba65845329098e0e06c54b9c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:38.927497 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-dfb51665-42b9-4d94-b7f1-4358f7f46320 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "GET /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5" status: 200 len: 1363 microversion: 2.1 time: 0.231275 Jan 28 02:06:38.937218 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 50/93] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:06:38 2022] GET /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5 => generated 1363 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:06:39.143778 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-086308b3-c63e-4b66-9f44-9d266531b73f tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:39.145008 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-086308b3-c63e-4b66-9f44-9d266531b73f tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] [instance: 2f0bfba5-38f6-4375-a6bf-25959ad11fe0] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:39.152288 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-086308b3-c63e-4b66-9f44-9d266531b73f tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:39.152957 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-086308b3-c63e-4b66-9f44-9d266531b73f tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:39.153886 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-086308b3-c63e-4b66-9f44-9d266531b73f tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:39.154457 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-086308b3-c63e-4b66-9f44-9d266531b73f tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:39.382708 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-086308b3-c63e-4b66-9f44-9d266531b73f tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd7039b8f074a13b2030a2bb7aaff94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc19a0f9c33f47f1b504bebbb0b2c931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:39.389885 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-086308b3-c63e-4b66-9f44-9d266531b73f tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] 10.222.0.79 "GET /compute/v2.1/servers/2f0bfba5-38f6-4375-a6bf-25959ad11fe0" status: 200 len: 1321 microversion: 2.1 time: 0.266520 Jan 28 02:06:39.390451 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 44/94] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:06:39 2022] GET /compute/v2.1/servers/2f0bfba5-38f6-4375-a6bf-25959ad11fe0 => generated 1321 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:06:39.720074 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-300b877f-86f4-4e94-abe2-14a06907e9a0 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:39.724764 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-300b877f-86f4-4e94-abe2-14a06907e9a0 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] [instance: c564cd2f-07df-4c91-9190-30cb5e9cb3ea] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:39.735667 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-300b877f-86f4-4e94-abe2-14a06907e9a0 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:39.746931 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-d3f8ac41-bbdc-4f2b-ab8b-f4febf422bfe tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:39.747555 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-d3f8ac41-bbdc-4f2b-ab8b-f4febf422bfe tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:39.750768 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-300b877f-86f4-4e94-abe2-14a06907e9a0 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:39.755620 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-d3f8ac41-bbdc-4f2b-ab8b-f4febf422bfe tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:39.756793 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-300b877f-86f4-4e94-abe2-14a06907e9a0 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:39.757238 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-300b877f-86f4-4e94-abe2-14a06907e9a0 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:39.768648 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-d3f8ac41-bbdc-4f2b-ab8b-f4febf422bfe tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:39.769504 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-d3f8ac41-bbdc-4f2b-ab8b-f4febf422bfe tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:39.769943 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-d3f8ac41-bbdc-4f2b-ab8b-f4febf422bfe tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:40.119398 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-300b877f-86f4-4e94-abe2-14a06907e9a0 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891908e1e9c8409ba9e91e341d08825e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22dd75c99404b48a867a48eb5d10c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:40.128691 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-300b877f-86f4-4e94-abe2-14a06907e9a0 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] 10.222.0.79 "GET /compute/v2.1/servers/c564cd2f-07df-4c91-9190-30cb5e9cb3ea" status: 200 len: 1314 microversion: 2.1 time: 0.419226 Jan 28 02:06:40.138129 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 51/95] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:06:39 2022] GET /compute/v2.1/servers/c564cd2f-07df-4c91-9190-30cb5e9cb3ea => generated 1314 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:06:40.147212 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-82a8530d-5c4f-4006-aade-52ff5ca4f997 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:40.147845 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-82a8530d-5c4f-4006-aade-52ff5ca4f997 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: d5f49055-da38-486c-9f10-1658c64d46f5] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:40.158997 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-82a8530d-5c4f-4006-aade-52ff5ca4f997 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:40.159741 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-d3f8ac41-bbdc-4f2b-ab8b-f4febf422bfe tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:40.163823 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-82a8530d-5c4f-4006-aade-52ff5ca4f997 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:40.164794 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-82a8530d-5c4f-4006-aade-52ff5ca4f997 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:40.167627 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-82a8530d-5c4f-4006-aade-52ff5ca4f997 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:40.173529 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-d3f8ac41-bbdc-4f2b-ab8b-f4febf422bfe tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:40.175323 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-d3f8ac41-bbdc-4f2b-ab8b-f4febf422bfe tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:40.176623 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-d3f8ac41-bbdc-4f2b-ab8b-f4febf422bfe tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84" status: 200 len: 1408 microversion: 2.20 time: 0.434509 Jan 28 02:06:40.177636 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 45/96] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:06:39 2022] GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84 => generated 1408 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:06:40.182805 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [req-e3538b3e-f7f8-4b43-a3ed-4557d1c6ce16 req-b38ee102-6574-42a2-9a0f-19ee588dd24b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5f49055-da38-486c-9f10-1658c64d46f5", "tag": "66c0ebdc-a262-49e8-983e-2b45feca212a"}]} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:06:40.184958 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:06:40.184958 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: warnings.warn(msg) Jan 28 02:06:40.193294 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-e3538b3e-f7f8-4b43-a3ed-4557d1c6ce16 req-b38ee102-6574-42a2-9a0f-19ee588dd24b service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:40.193977 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-e3538b3e-f7f8-4b43-a3ed-4557d1c6ce16 req-b38ee102-6574-42a2-9a0f-19ee588dd24b service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:40.208098 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.compute.server_external_events [req-e3538b3e-f7f8-4b43-a3ed-4557d1c6ce16 req-b38ee102-6574-42a2-9a0f-19ee588dd24b service nova] Creating event network-changed:66c0ebdc-a262-49e8-983e-2b45feca212a for instance d5f49055-da38-486c-9f10-1658c64d46f5 on hv-cinder-82497 Jan 28 02:06:40.213702 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [req-e3538b3e-f7f8-4b43-a3ed-4557d1c6ce16 req-b38ee102-6574-42a2-9a0f-19ee588dd24b service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034706 Jan 28 02:06:40.214854 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 46/97] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Jan 28 02:06:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:06:40.331911 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-82a8530d-5c4f-4006-aade-52ff5ca4f997 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acab2a0c4a0e48909317791a3de85b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abe012ba65845329098e0e06c54b9c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:40.339530 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-82a8530d-5c4f-4006-aade-52ff5ca4f997 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "GET /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5" status: 200 len: 1363 microversion: 2.1 time: 0.200226 Jan 28 02:06:40.340378 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 52/98] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:06:40 2022] GET /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5 => generated 1363 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:06:40.407788 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-3420bfeb-9ef8-4eae-b933-f7687c9a0526 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:40.408715 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-3420bfeb-9ef8-4eae-b933-f7687c9a0526 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] [instance: 2f0bfba5-38f6-4375-a6bf-25959ad11fe0] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:40.429202 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-3420bfeb-9ef8-4eae-b933-f7687c9a0526 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:40.429932 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-3420bfeb-9ef8-4eae-b933-f7687c9a0526 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:40.430887 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-3420bfeb-9ef8-4eae-b933-f7687c9a0526 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:40.431469 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-3420bfeb-9ef8-4eae-b933-f7687c9a0526 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:40.628580 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [req-e3ed11e4-eac3-4b7f-8260-56bced6192b4 req-85041e64-2d21-49cb-9560-11a0da86618d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f0bfba5-38f6-4375-a6bf-25959ad11fe0", "name": "network-vif-plugged", "status": "completed", "tag": "f563e565-6b72-491c-a99c-3004a4f17f98"}]} {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:06:40.630306 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:06:40.630306 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: warnings.warn(msg) Jan 28 02:06:40.646264 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [req-e3ed11e4-eac3-4b7f-8260-56bced6192b4 req-85041e64-2d21-49cb-9560-11a0da86618d service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:40.647238 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [req-e3ed11e4-eac3-4b7f-8260-56bced6192b4 req-85041e64-2d21-49cb-9560-11a0da86618d service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:40.653021 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-3420bfeb-9ef8-4eae-b933-f7687c9a0526 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd7039b8f074a13b2030a2bb7aaff94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc19a0f9c33f47f1b504bebbb0b2c931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:40.664727 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-3420bfeb-9ef8-4eae-b933-f7687c9a0526 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] 10.222.0.79 "GET /compute/v2.1/servers/2f0bfba5-38f6-4375-a6bf-25959ad11fe0" status: 200 len: 1321 microversion: 2.1 time: 0.260880 Jan 28 02:06:40.665418 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 47/99] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:06:40 2022] GET /compute/v2.1/servers/2f0bfba5-38f6-4375-a6bf-25959ad11fe0 => generated 1321 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:06:40.674659 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.compute.server_external_events [req-e3ed11e4-eac3-4b7f-8260-56bced6192b4 req-85041e64-2d21-49cb-9560-11a0da86618d service nova] Creating event network-vif-plugged:f563e565-6b72-491c-a99c-3004a4f17f98 for instance 2f0bfba5-38f6-4375-a6bf-25959ad11fe0 on hv-cinder-82497 Jan 28 02:06:40.680312 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [req-e3ed11e4-eac3-4b7f-8260-56bced6192b4 req-85041e64-2d21-49cb-9560-11a0da86618d service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146518 Jan 28 02:06:40.681413 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 53/100] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Jan 28 02:06:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:06:41.154547 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-b2f47bf4-0ba1-4ba4-90e4-c52446fe4fa3 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:41.159390 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-b2f47bf4-0ba1-4ba4-90e4-c52446fe4fa3 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] [instance: c564cd2f-07df-4c91-9190-30cb5e9cb3ea] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:41.161084 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b2f47bf4-0ba1-4ba4-90e4-c52446fe4fa3 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:41.161613 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b2f47bf4-0ba1-4ba4-90e4-c52446fe4fa3 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:41.162266 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b2f47bf4-0ba1-4ba4-90e4-c52446fe4fa3 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:41.162691 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b2f47bf4-0ba1-4ba4-90e4-c52446fe4fa3 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:41.194894 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-132586a7-f928-4632-9165-085c2408e8ef tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:41.205447 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-132586a7-f928-4632-9165-085c2408e8ef tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:41.211784 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-132586a7-f928-4632-9165-085c2408e8ef tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:41.212478 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-132586a7-f928-4632-9165-085c2408e8ef tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:41.213523 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-132586a7-f928-4632-9165-085c2408e8ef tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:41.214053 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-132586a7-f928-4632-9165-085c2408e8ef tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:41.324010 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-b2f47bf4-0ba1-4ba4-90e4-c52446fe4fa3 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891908e1e9c8409ba9e91e341d08825e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22dd75c99404b48a867a48eb5d10c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:41.332183 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-b2f47bf4-0ba1-4ba4-90e4-c52446fe4fa3 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] 10.222.0.79 "GET /compute/v2.1/servers/c564cd2f-07df-4c91-9190-30cb5e9cb3ea" status: 200 len: 1314 microversion: 2.1 time: 0.181260 Jan 28 02:06:41.332918 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 48/101] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:06:41 2022] GET /compute/v2.1/servers/c564cd2f-07df-4c91-9190-30cb5e9cb3ea => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:06:41.357233 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-eb51564b-1678-45c0-9236-e4ee4a119df6 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:41.357856 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-eb51564b-1678-45c0-9236-e4ee4a119df6 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: d5f49055-da38-486c-9f10-1658c64d46f5] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:41.364403 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-eb51564b-1678-45c0-9236-e4ee4a119df6 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:41.364845 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-eb51564b-1678-45c0-9236-e4ee4a119df6 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:41.365606 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-eb51564b-1678-45c0-9236-e4ee4a119df6 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:41.366029 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-eb51564b-1678-45c0-9236-e4ee4a119df6 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:41.381498 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-132586a7-f928-4632-9165-085c2408e8ef tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:41.385465 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-132586a7-f928-4632-9165-085c2408e8ef tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:41.386948 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-132586a7-f928-4632-9165-085c2408e8ef tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:41.388058 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-132586a7-f928-4632-9165-085c2408e8ef tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84" status: 200 len: 1408 microversion: 2.20 time: 0.197184 Jan 28 02:06:41.388614 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 54/102] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:06:41 2022] GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84 => generated 1408 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 02:06:41.496958 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-eb51564b-1678-45c0-9236-e4ee4a119df6 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acab2a0c4a0e48909317791a3de85b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abe012ba65845329098e0e06c54b9c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:41.506714 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-eb51564b-1678-45c0-9236-e4ee4a119df6 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "GET /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5" status: 200 len: 1363 microversion: 2.1 time: 0.153027 Jan 28 02:06:41.512155 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 49/103] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:06:41 2022] GET /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:06:41.679805 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-e741487e-59e3-4590-a87a-b1f047e29363 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:41.680505 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-e741487e-59e3-4590-a87a-b1f047e29363 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] [instance: 2f0bfba5-38f6-4375-a6bf-25959ad11fe0] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:41.687651 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-e741487e-59e3-4590-a87a-b1f047e29363 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:41.688094 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-e741487e-59e3-4590-a87a-b1f047e29363 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:41.688872 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-e741487e-59e3-4590-a87a-b1f047e29363 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:41.689286 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-e741487e-59e3-4590-a87a-b1f047e29363 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:41.810555 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-e741487e-59e3-4590-a87a-b1f047e29363 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd7039b8f074a13b2030a2bb7aaff94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc19a0f9c33f47f1b504bebbb0b2c931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:41.818089 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-e741487e-59e3-4590-a87a-b1f047e29363 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] 10.222.0.79 "GET /compute/v2.1/servers/2f0bfba5-38f6-4375-a6bf-25959ad11fe0" status: 200 len: 1321 microversion: 2.1 time: 0.141986 Jan 28 02:06:41.818657 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 55/104] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:06:41 2022] GET /compute/v2.1/servers/2f0bfba5-38f6-4375-a6bf-25959ad11fe0 => generated 1321 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:06:42.349983 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-6b15d211-859c-44fc-bde6-14c33323dc9e tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:42.350579 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-6b15d211-859c-44fc-bde6-14c33323dc9e tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] [instance: c564cd2f-07df-4c91-9190-30cb5e9cb3ea] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:42.356482 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-6b15d211-859c-44fc-bde6-14c33323dc9e tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:42.356923 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-6b15d211-859c-44fc-bde6-14c33323dc9e tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:42.357679 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-6b15d211-859c-44fc-bde6-14c33323dc9e tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:42.358108 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-6b15d211-859c-44fc-bde6-14c33323dc9e tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:42.405703 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-8b4fa3c2-51d1-4931-8d77-c02b3f7548e8 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:42.406315 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-8b4fa3c2-51d1-4931-8d77-c02b3f7548e8 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:42.412937 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-8b4fa3c2-51d1-4931-8d77-c02b3f7548e8 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:42.413379 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-8b4fa3c2-51d1-4931-8d77-c02b3f7548e8 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:42.414139 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-8b4fa3c2-51d1-4931-8d77-c02b3f7548e8 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:42.414560 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-8b4fa3c2-51d1-4931-8d77-c02b3f7548e8 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:42.509605 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-6b15d211-859c-44fc-bde6-14c33323dc9e tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891908e1e9c8409ba9e91e341d08825e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22dd75c99404b48a867a48eb5d10c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:42.517249 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-6b15d211-859c-44fc-bde6-14c33323dc9e tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] 10.222.0.79 "GET /compute/v2.1/servers/c564cd2f-07df-4c91-9190-30cb5e9cb3ea" status: 200 len: 1314 microversion: 2.1 time: 0.171001 Jan 28 02:06:42.518027 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 50/105] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:06:42 2022] GET /compute/v2.1/servers/c564cd2f-07df-4c91-9190-30cb5e9cb3ea => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:06:42.524965 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-355233dd-e2cc-4524-ae2f-97853c9babe3 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:42.525579 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-355233dd-e2cc-4524-ae2f-97853c9babe3 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: d5f49055-da38-486c-9f10-1658c64d46f5] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:42.531274 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-355233dd-e2cc-4524-ae2f-97853c9babe3 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:42.533527 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-355233dd-e2cc-4524-ae2f-97853c9babe3 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:42.534338 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-355233dd-e2cc-4524-ae2f-97853c9babe3 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:42.534770 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-355233dd-e2cc-4524-ae2f-97853c9babe3 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:42.564433 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-8b4fa3c2-51d1-4931-8d77-c02b3f7548e8 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:42.571576 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-8b4fa3c2-51d1-4931-8d77-c02b3f7548e8 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:42.573097 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-8b4fa3c2-51d1-4931-8d77-c02b3f7548e8 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:42.574186 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-8b4fa3c2-51d1-4931-8d77-c02b3f7548e8 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84" status: 200 len: 1408 microversion: 2.20 time: 0.172203 Jan 28 02:06:42.574730 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 56/106] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:06:42 2022] GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84 => generated 1408 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 02:06:42.670828 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-355233dd-e2cc-4524-ae2f-97853c9babe3 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acab2a0c4a0e48909317791a3de85b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abe012ba65845329098e0e06c54b9c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:42.678788 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-355233dd-e2cc-4524-ae2f-97853c9babe3 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "GET /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5" status: 200 len: 1363 microversion: 2.1 time: 0.157195 Jan 28 02:06:42.679859 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 51/107] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:06:42 2022] GET /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5 => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:06:42.696513 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [req-4443b918-e425-4b28-9103-4564bb41121d req-27476e7e-5d5f-4b71-bdaf-9e453be74e22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c564cd2f-07df-4c91-9190-30cb5e9cb3ea", "name": "network-vif-plugged", "status": "completed", "tag": "f7f220d5-8156-4a22-9350-5b5670680867"}, {"server_uuid": "ec5e47ac-761b-467f-958c-516a9f8bc3e6", "name": "network-vif-plugged", "status": "completed", "tag": "333b77f2-3cf1-4c8f-94ce-5901a7eb748d"}]} {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:06:42.698236 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:06:42.698236 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: warnings.warn(msg) Jan 28 02:06:42.706829 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [req-4443b918-e425-4b28-9103-4564bb41121d req-27476e7e-5d5f-4b71-bdaf-9e453be74e22 service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:42.707332 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [req-4443b918-e425-4b28-9103-4564bb41121d req-27476e7e-5d5f-4b71-bdaf-9e453be74e22 service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:42.720700 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.compute.server_external_events [req-4443b918-e425-4b28-9103-4564bb41121d req-27476e7e-5d5f-4b71-bdaf-9e453be74e22 service nova] Creating event network-vif-plugged:f7f220d5-8156-4a22-9350-5b5670680867 for instance c564cd2f-07df-4c91-9190-30cb5e9cb3ea on hv-cinder-82497 Jan 28 02:06:42.721279 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.compute.server_external_events [req-4443b918-e425-4b28-9103-4564bb41121d req-27476e7e-5d5f-4b71-bdaf-9e453be74e22 service nova] Creating event network-vif-plugged:333b77f2-3cf1-4c8f-94ce-5901a7eb748d for instance ec5e47ac-761b-467f-958c-516a9f8bc3e6 on hv-cinder-82497 Jan 28 02:06:42.727798 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [req-4443b918-e425-4b28-9103-4564bb41121d req-27476e7e-5d5f-4b71-bdaf-9e453be74e22 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.034842 Jan 28 02:06:42.728412 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 57/108] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Jan 28 02:06:42 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 02:06:42.834439 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-8a860ac4-d95d-47d5-8b4d-3de6b2e01a8e tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:42.835051 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-8a860ac4-d95d-47d5-8b4d-3de6b2e01a8e tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] [instance: 2f0bfba5-38f6-4375-a6bf-25959ad11fe0] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:42.841147 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-8a860ac4-d95d-47d5-8b4d-3de6b2e01a8e tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:42.841900 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-8a860ac4-d95d-47d5-8b4d-3de6b2e01a8e tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:42.842664 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-8a860ac4-d95d-47d5-8b4d-3de6b2e01a8e tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:42.843097 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-8a860ac4-d95d-47d5-8b4d-3de6b2e01a8e tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:42.962997 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-8a860ac4-d95d-47d5-8b4d-3de6b2e01a8e tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd7039b8f074a13b2030a2bb7aaff94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc19a0f9c33f47f1b504bebbb0b2c931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:42.970630 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-8a860ac4-d95d-47d5-8b4d-3de6b2e01a8e tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] 10.222.0.79 "GET /compute/v2.1/servers/2f0bfba5-38f6-4375-a6bf-25959ad11fe0" status: 200 len: 1321 microversion: 2.1 time: 0.139983 Jan 28 02:06:42.971196 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 52/109] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:06:42 2022] GET /compute/v2.1/servers/2f0bfba5-38f6-4375-a6bf-25959ad11fe0 => generated 1321 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:06:43.534262 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-f1320589-4a79-440b-8db0-895be3f3d007 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:43.534976 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-f1320589-4a79-440b-8db0-895be3f3d007 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] [instance: c564cd2f-07df-4c91-9190-30cb5e9cb3ea] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:43.540940 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-f1320589-4a79-440b-8db0-895be3f3d007 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:43.541554 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-f1320589-4a79-440b-8db0-895be3f3d007 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:43.542158 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-f1320589-4a79-440b-8db0-895be3f3d007 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:43.542587 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-f1320589-4a79-440b-8db0-895be3f3d007 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:43.598903 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-caa86a3e-457e-41ef-a72c-4cf8b18da202 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:43.606241 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-caa86a3e-457e-41ef-a72c-4cf8b18da202 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:43.625353 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-caa86a3e-457e-41ef-a72c-4cf8b18da202 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:43.626976 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-caa86a3e-457e-41ef-a72c-4cf8b18da202 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:43.638294 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-caa86a3e-457e-41ef-a72c-4cf8b18da202 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:43.639188 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-caa86a3e-457e-41ef-a72c-4cf8b18da202 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:43.903828 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-f1320589-4a79-440b-8db0-895be3f3d007 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891908e1e9c8409ba9e91e341d08825e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22dd75c99404b48a867a48eb5d10c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:43.911436 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-f1320589-4a79-440b-8db0-895be3f3d007 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] 10.222.0.79 "GET /compute/v2.1/servers/c564cd2f-07df-4c91-9190-30cb5e9cb3ea" status: 200 len: 1314 microversion: 2.1 time: 0.381840 Jan 28 02:06:43.912029 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 58/110] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:06:43 2022] GET /compute/v2.1/servers/c564cd2f-07df-4c91-9190-30cb5e9cb3ea => generated 1314 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:06:43.930534 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-11f51961-94d5-45e1-9add-aac86f0e0bfb tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:43.931139 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-11f51961-94d5-45e1-9add-aac86f0e0bfb tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: d5f49055-da38-486c-9f10-1658c64d46f5] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:43.937388 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-11f51961-94d5-45e1-9add-aac86f0e0bfb tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:43.938551 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-11f51961-94d5-45e1-9add-aac86f0e0bfb tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:43.939389 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-11f51961-94d5-45e1-9add-aac86f0e0bfb tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:43.940015 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-11f51961-94d5-45e1-9add-aac86f0e0bfb tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:43.984146 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-caa86a3e-457e-41ef-a72c-4cf8b18da202 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:43.998352 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-caa86a3e-457e-41ef-a72c-4cf8b18da202 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:44.001290 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-caa86a3e-457e-41ef-a72c-4cf8b18da202 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:44.004374 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-caa86a3e-457e-41ef-a72c-4cf8b18da202 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84" status: 200 len: 1408 microversion: 2.20 time: 0.415402 Jan 28 02:06:44.005549 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 53/111] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:06:43 2022] GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84 => generated 1408 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:06:44.018933 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-a4feee43-47d8-494f-99cd-b38d05c38d05 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:44.024543 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-a4feee43-47d8-494f-99cd-b38d05c38d05 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] [instance: 2f0bfba5-38f6-4375-a6bf-25959ad11fe0] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:44.028079 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a4feee43-47d8-494f-99cd-b38d05c38d05 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:44.029043 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a4feee43-47d8-494f-99cd-b38d05c38d05 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:44.030631 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a4feee43-47d8-494f-99cd-b38d05c38d05 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:44.031750 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a4feee43-47d8-494f-99cd-b38d05c38d05 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:44.193962 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-11f51961-94d5-45e1-9add-aac86f0e0bfb tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acab2a0c4a0e48909317791a3de85b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abe012ba65845329098e0e06c54b9c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:44.199834 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-11f51961-94d5-45e1-9add-aac86f0e0bfb tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "GET /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5" status: 200 len: 1363 microversion: 2.1 time: 0.286377 Jan 28 02:06:44.200386 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 59/112] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:06:43 2022] GET /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5 => generated 1363 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:06:44.242185 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-a4feee43-47d8-494f-99cd-b38d05c38d05 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd7039b8f074a13b2030a2bb7aaff94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc19a0f9c33f47f1b504bebbb0b2c931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:44.250758 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-a4feee43-47d8-494f-99cd-b38d05c38d05 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] 10.222.0.79 "GET /compute/v2.1/servers/2f0bfba5-38f6-4375-a6bf-25959ad11fe0" status: 200 len: 1321 microversion: 2.1 time: 0.242476 Jan 28 02:06:44.251341 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 54/113] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:06:44 2022] GET /compute/v2.1/servers/2f0bfba5-38f6-4375-a6bf-25959ad11fe0 => generated 1321 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:06:44.927665 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-c7a6987c-0efe-44e1-ad13-ccc4bc844864 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:44.929152 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-c7a6987c-0efe-44e1-ad13-ccc4bc844864 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] [instance: c564cd2f-07df-4c91-9190-30cb5e9cb3ea] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:44.936347 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-c7a6987c-0efe-44e1-ad13-ccc4bc844864 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:44.936968 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-c7a6987c-0efe-44e1-ad13-ccc4bc844864 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:44.938474 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-c7a6987c-0efe-44e1-ad13-ccc4bc844864 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:44.938847 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-c7a6987c-0efe-44e1-ad13-ccc4bc844864 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:45.023300 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-c3d46965-1223-4b8d-9548-96aacdec4933 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:45.024767 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-c3d46965-1223-4b8d-9548-96aacdec4933 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:45.031019 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c3d46965-1223-4b8d-9548-96aacdec4933 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:45.032671 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c3d46965-1223-4b8d-9548-96aacdec4933 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:45.033348 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c3d46965-1223-4b8d-9548-96aacdec4933 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:45.033934 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c3d46965-1223-4b8d-9548-96aacdec4933 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:45.093020 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-c7a6987c-0efe-44e1-ad13-ccc4bc844864 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891908e1e9c8409ba9e91e341d08825e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22dd75c99404b48a867a48eb5d10c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:45.101656 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-c7a6987c-0efe-44e1-ad13-ccc4bc844864 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] 10.222.0.79 "GET /compute/v2.1/servers/c564cd2f-07df-4c91-9190-30cb5e9cb3ea" status: 200 len: 1314 microversion: 2.1 time: 0.177609 Jan 28 02:06:45.108125 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 60/114] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:06:44 2022] GET /compute/v2.1/servers/c564cd2f-07df-4c91-9190-30cb5e9cb3ea => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:06:45.183178 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-c3d46965-1223-4b8d-9548-96aacdec4933 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:45.191288 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-c3d46965-1223-4b8d-9548-96aacdec4933 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:45.192852 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-c3d46965-1223-4b8d-9548-96aacdec4933 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:45.193964 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-c3d46965-1223-4b8d-9548-96aacdec4933 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84" status: 200 len: 1408 microversion: 2.20 time: 0.174704 Jan 28 02:06:45.194727 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 55/115] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:06:45 2022] GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84 => generated 1408 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:06:45.217413 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-79926494-90ea-455f-9135-e2a0aaf30737 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:45.218015 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-79926494-90ea-455f-9135-e2a0aaf30737 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: d5f49055-da38-486c-9f10-1658c64d46f5] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:45.225042 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-79926494-90ea-455f-9135-e2a0aaf30737 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:45.231296 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-79926494-90ea-455f-9135-e2a0aaf30737 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:45.231296 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-79926494-90ea-455f-9135-e2a0aaf30737 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:45.231296 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-79926494-90ea-455f-9135-e2a0aaf30737 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:45.267480 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-033fb992-b049-45a9-a194-b47deedb684e tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:45.268106 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-033fb992-b049-45a9-a194-b47deedb684e tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] [instance: 2f0bfba5-38f6-4375-a6bf-25959ad11fe0] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:45.275852 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-033fb992-b049-45a9-a194-b47deedb684e tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:45.276350 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-033fb992-b049-45a9-a194-b47deedb684e tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:45.277118 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-033fb992-b049-45a9-a194-b47deedb684e tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:45.277634 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-033fb992-b049-45a9-a194-b47deedb684e tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:45.403506 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-79926494-90ea-455f-9135-e2a0aaf30737 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acab2a0c4a0e48909317791a3de85b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abe012ba65845329098e0e06c54b9c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:45.408244 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-79926494-90ea-455f-9135-e2a0aaf30737 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "GET /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5" status: 200 len: 1363 microversion: 2.1 time: 0.194881 Jan 28 02:06:45.408824 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 61/116] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:06:45 2022] GET /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5 => generated 1363 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:06:45.435667 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-033fb992-b049-45a9-a194-b47deedb684e tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd7039b8f074a13b2030a2bb7aaff94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc19a0f9c33f47f1b504bebbb0b2c931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:45.442991 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-033fb992-b049-45a9-a194-b47deedb684e tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] 10.222.0.79 "GET /compute/v2.1/servers/2f0bfba5-38f6-4375-a6bf-25959ad11fe0" status: 200 len: 1321 microversion: 2.1 time: 0.179785 Jan 28 02:06:45.446405 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 56/117] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:06:45 2022] GET /compute/v2.1/servers/2f0bfba5-38f6-4375-a6bf-25959ad11fe0 => generated 1321 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:06:46.118392 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-caca0b6a-a647-4868-868e-0abfe328244b tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:46.125667 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-caca0b6a-a647-4868-868e-0abfe328244b tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] [instance: c564cd2f-07df-4c91-9190-30cb5e9cb3ea] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:46.125667 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-caca0b6a-a647-4868-868e-0abfe328244b tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:46.125871 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-caca0b6a-a647-4868-868e-0abfe328244b tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:46.126854 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-caca0b6a-a647-4868-868e-0abfe328244b tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:46.127286 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-caca0b6a-a647-4868-868e-0abfe328244b tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:46.212855 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-1d6fa123-2ca8-4d6f-9e20-191f9d02aca6 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:46.213594 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-1d6fa123-2ca8-4d6f-9e20-191f9d02aca6 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:46.220143 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-1d6fa123-2ca8-4d6f-9e20-191f9d02aca6 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:46.220707 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-1d6fa123-2ca8-4d6f-9e20-191f9d02aca6 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:46.221566 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-1d6fa123-2ca8-4d6f-9e20-191f9d02aca6 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:46.222023 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-1d6fa123-2ca8-4d6f-9e20-191f9d02aca6 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:46.257533 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-caca0b6a-a647-4868-868e-0abfe328244b tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891908e1e9c8409ba9e91e341d08825e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22dd75c99404b48a867a48eb5d10c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:46.257896 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-caca0b6a-a647-4868-868e-0abfe328244b tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] 10.222.0.79 "GET /compute/v2.1/servers/c564cd2f-07df-4c91-9190-30cb5e9cb3ea" status: 200 len: 1314 microversion: 2.1 time: 0.142992 Jan 28 02:06:46.258465 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 62/118] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:06:46 2022] GET /compute/v2.1/servers/c564cd2f-07df-4c91-9190-30cb5e9cb3ea => generated 1314 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:06:46.342082 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-1d6fa123-2ca8-4d6f-9e20-191f9d02aca6 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:46.350507 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-1d6fa123-2ca8-4d6f-9e20-191f9d02aca6 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:46.352103 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-1d6fa123-2ca8-4d6f-9e20-191f9d02aca6 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:46.353305 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-1d6fa123-2ca8-4d6f-9e20-191f9d02aca6 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84" status: 200 len: 1408 microversion: 2.20 time: 0.144202 Jan 28 02:06:46.353877 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 57/119] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:06:46 2022] GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84 => generated 1408 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 02:06:46.424811 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-7d689d5f-aef4-4142-baf6-a0a15e46459e tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:46.425407 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-7d689d5f-aef4-4142-baf6-a0a15e46459e tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: d5f49055-da38-486c-9f10-1658c64d46f5] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:46.431291 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-7d689d5f-aef4-4142-baf6-a0a15e46459e tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:46.431890 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-7d689d5f-aef4-4142-baf6-a0a15e46459e tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:46.432665 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-7d689d5f-aef4-4142-baf6-a0a15e46459e tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:46.433092 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-7d689d5f-aef4-4142-baf6-a0a15e46459e tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:46.458988 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-a238c2a0-57fa-4414-b2af-e8ccd954dd18 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:46.459748 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-a238c2a0-57fa-4414-b2af-e8ccd954dd18 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] [instance: 2f0bfba5-38f6-4375-a6bf-25959ad11fe0] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:46.465978 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a238c2a0-57fa-4414-b2af-e8ccd954dd18 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:46.466420 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a238c2a0-57fa-4414-b2af-e8ccd954dd18 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:46.467180 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a238c2a0-57fa-4414-b2af-e8ccd954dd18 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:46.467611 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a238c2a0-57fa-4414-b2af-e8ccd954dd18 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:46.593698 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-7d689d5f-aef4-4142-baf6-a0a15e46459e tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acab2a0c4a0e48909317791a3de85b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abe012ba65845329098e0e06c54b9c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:46.601049 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-7d689d5f-aef4-4142-baf6-a0a15e46459e tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "GET /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5" status: 200 len: 1363 microversion: 2.1 time: 0.180476 Jan 28 02:06:46.601614 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 63/120] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:06:46 2022] GET /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5 => generated 1363 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:06:46.630737 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-a238c2a0-57fa-4414-b2af-e8ccd954dd18 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd7039b8f074a13b2030a2bb7aaff94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc19a0f9c33f47f1b504bebbb0b2c931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:46.638219 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-a238c2a0-57fa-4414-b2af-e8ccd954dd18 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] 10.222.0.79 "GET /compute/v2.1/servers/2f0bfba5-38f6-4375-a6bf-25959ad11fe0" status: 200 len: 1321 microversion: 2.1 time: 0.182888 Jan 28 02:06:46.638730 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 58/121] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:06:46 2022] GET /compute/v2.1/servers/2f0bfba5-38f6-4375-a6bf-25959ad11fe0 => generated 1321 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:06:47.032313 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [req-9cdbfea7-46c4-486a-a045-50c9009fbf8e req-45f7e160-ebab-45f4-bf4c-8e47c3dfd876 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f25403b-0399-48d0-86a9-6e5022287c84", "name": "network-vif-plugged", "status": "completed", "tag": "eb8f729a-b66f-4c5c-a62e-472c346922bb"}]} {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:06:47.034021 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:06:47.034021 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: warnings.warn(msg) Jan 28 02:06:47.040703 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [req-9cdbfea7-46c4-486a-a045-50c9009fbf8e req-45f7e160-ebab-45f4-bf4c-8e47c3dfd876 service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:47.041146 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [req-9cdbfea7-46c4-486a-a045-50c9009fbf8e req-45f7e160-ebab-45f4-bf4c-8e47c3dfd876 service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:47.051681 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.compute.server_external_events [req-9cdbfea7-46c4-486a-a045-50c9009fbf8e req-45f7e160-ebab-45f4-bf4c-8e47c3dfd876 service nova] Creating event network-vif-plugged:eb8f729a-b66f-4c5c-a62e-472c346922bb for instance 4f25403b-0399-48d0-86a9-6e5022287c84 on hv-cinder-82497 Jan 28 02:06:47.057072 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [req-9cdbfea7-46c4-486a-a045-50c9009fbf8e req-45f7e160-ebab-45f4-bf4c-8e47c3dfd876 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028228 Jan 28 02:06:47.057712 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 64/122] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Jan 28 02:06:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:06:47.275009 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-abacbf15-ea92-4597-9695-bfb1da25ddff tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:47.275639 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-abacbf15-ea92-4597-9695-bfb1da25ddff tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] [instance: c564cd2f-07df-4c91-9190-30cb5e9cb3ea] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:47.281583 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-abacbf15-ea92-4597-9695-bfb1da25ddff tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:47.282022 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-abacbf15-ea92-4597-9695-bfb1da25ddff tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:47.282772 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-abacbf15-ea92-4597-9695-bfb1da25ddff tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:47.283200 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-abacbf15-ea92-4597-9695-bfb1da25ddff tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:47.370918 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-c245ee03-c19e-43b7-99f6-2873a0ce689c tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:47.371629 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-c245ee03-c19e-43b7-99f6-2873a0ce689c tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:47.378997 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-c245ee03-c19e-43b7-99f6-2873a0ce689c tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:47.379438 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-c245ee03-c19e-43b7-99f6-2873a0ce689c tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:47.380334 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-c245ee03-c19e-43b7-99f6-2873a0ce689c tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:47.380762 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-c245ee03-c19e-43b7-99f6-2873a0ce689c tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:47.403369 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-abacbf15-ea92-4597-9695-bfb1da25ddff tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891908e1e9c8409ba9e91e341d08825e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22dd75c99404b48a867a48eb5d10c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:47.410950 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-abacbf15-ea92-4597-9695-bfb1da25ddff tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] 10.222.0.79 "GET /compute/v2.1/servers/c564cd2f-07df-4c91-9190-30cb5e9cb3ea" status: 200 len: 1314 microversion: 2.1 time: 0.139714 Jan 28 02:06:47.411514 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 59/123] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:06:47 2022] GET /compute/v2.1/servers/c564cd2f-07df-4c91-9190-30cb5e9cb3ea => generated 1314 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:06:47.506770 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-c245ee03-c19e-43b7-99f6-2873a0ce689c tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:47.514407 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-c245ee03-c19e-43b7-99f6-2873a0ce689c tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:47.515908 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-c245ee03-c19e-43b7-99f6-2873a0ce689c tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:47.517026 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-c245ee03-c19e-43b7-99f6-2873a0ce689c tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84" status: 200 len: 1408 microversion: 2.20 time: 0.150063 Jan 28 02:06:47.517579 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 65/124] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:06:47 2022] GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84 => generated 1408 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 02:06:47.618676 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-9fde42cb-22d8-46ab-9e40-a9cbb179580b tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:47.619178 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-9fde42cb-22d8-46ab-9e40-a9cbb179580b tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: d5f49055-da38-486c-9f10-1658c64d46f5] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:47.625011 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-9fde42cb-22d8-46ab-9e40-a9cbb179580b tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:47.625698 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-9fde42cb-22d8-46ab-9e40-a9cbb179580b tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:47.626501 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-9fde42cb-22d8-46ab-9e40-a9cbb179580b tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:47.626928 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-9fde42cb-22d8-46ab-9e40-a9cbb179580b tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:47.654487 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-ea9c8082-03df-461a-9306-14b5487113de tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:47.655093 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-ea9c8082-03df-461a-9306-14b5487113de tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] [instance: 2f0bfba5-38f6-4375-a6bf-25959ad11fe0] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:47.663724 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-ea9c8082-03df-461a-9306-14b5487113de tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:47.663922 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-ea9c8082-03df-461a-9306-14b5487113de tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:47.664667 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-ea9c8082-03df-461a-9306-14b5487113de tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:47.665042 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-ea9c8082-03df-461a-9306-14b5487113de tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:47.772741 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-9fde42cb-22d8-46ab-9e40-a9cbb179580b tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acab2a0c4a0e48909317791a3de85b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abe012ba65845329098e0e06c54b9c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:47.784757 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-9fde42cb-22d8-46ab-9e40-a9cbb179580b tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "GET /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5" status: 200 len: 1363 microversion: 2.1 time: 0.169003 Jan 28 02:06:47.785344 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 60/125] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:06:47 2022] GET /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5 => generated 1363 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:06:47.834059 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-ea9c8082-03df-461a-9306-14b5487113de tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd7039b8f074a13b2030a2bb7aaff94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc19a0f9c33f47f1b504bebbb0b2c931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:47.841572 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-ea9c8082-03df-461a-9306-14b5487113de tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] 10.222.0.79 "GET /compute/v2.1/servers/2f0bfba5-38f6-4375-a6bf-25959ad11fe0" status: 200 len: 1321 microversion: 2.1 time: 0.191038 Jan 28 02:06:47.842138 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 66/126] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:06:47 2022] GET /compute/v2.1/servers/2f0bfba5-38f6-4375-a6bf-25959ad11fe0 => generated 1321 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:06:48.427776 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-27ea124b-15f4-45d1-bfa0-5c0e5a9d141a tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:48.428677 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-27ea124b-15f4-45d1-bfa0-5c0e5a9d141a tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] [instance: c564cd2f-07df-4c91-9190-30cb5e9cb3ea] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:48.434590 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-27ea124b-15f4-45d1-bfa0-5c0e5a9d141a tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:48.435026 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-27ea124b-15f4-45d1-bfa0-5c0e5a9d141a tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:48.435893 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-27ea124b-15f4-45d1-bfa0-5c0e5a9d141a tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:48.436341 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-27ea124b-15f4-45d1-bfa0-5c0e5a9d141a tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:48.535135 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-09fe50ff-3a15-4db5-ab96-0cd998a631cb tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:48.535732 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-09fe50ff-3a15-4db5-ab96-0cd998a631cb tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:48.541381 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-09fe50ff-3a15-4db5-ab96-0cd998a631cb tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:48.541817 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-09fe50ff-3a15-4db5-ab96-0cd998a631cb tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:48.542574 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-09fe50ff-3a15-4db5-ab96-0cd998a631cb tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:48.542998 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-09fe50ff-3a15-4db5-ab96-0cd998a631cb tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:48.558849 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-27ea124b-15f4-45d1-bfa0-5c0e5a9d141a tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891908e1e9c8409ba9e91e341d08825e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22dd75c99404b48a867a48eb5d10c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:48.566480 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-27ea124b-15f4-45d1-bfa0-5c0e5a9d141a tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] 10.222.0.79 "GET /compute/v2.1/servers/c564cd2f-07df-4c91-9190-30cb5e9cb3ea" status: 200 len: 1314 microversion: 2.1 time: 0.142359 Jan 28 02:06:48.567047 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 61/127] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:06:48 2022] GET /compute/v2.1/servers/c564cd2f-07df-4c91-9190-30cb5e9cb3ea => generated 1314 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:06:48.663801 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-09fe50ff-3a15-4db5-ab96-0cd998a631cb tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:48.671635 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-09fe50ff-3a15-4db5-ab96-0cd998a631cb tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:48.673812 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-09fe50ff-3a15-4db5-ab96-0cd998a631cb tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:48.674993 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-09fe50ff-3a15-4db5-ab96-0cd998a631cb tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84" status: 200 len: 1408 microversion: 2.20 time: 0.144238 Jan 28 02:06:48.675548 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 67/128] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:06:48 2022] GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84 => generated 1408 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 02:06:48.800942 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-caab25c6-93fe-4288-abc4-e356a993fd53 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:48.801539 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-caab25c6-93fe-4288-abc4-e356a993fd53 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: d5f49055-da38-486c-9f10-1658c64d46f5] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:48.808413 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-caab25c6-93fe-4288-abc4-e356a993fd53 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:48.814038 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-caab25c6-93fe-4288-abc4-e356a993fd53 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:48.814038 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-caab25c6-93fe-4288-abc4-e356a993fd53 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:48.814038 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-caab25c6-93fe-4288-abc4-e356a993fd53 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:48.858282 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-ac067752-4c18-4a85-832b-fc922ad0f827 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:48.859171 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-ac067752-4c18-4a85-832b-fc922ad0f827 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] [instance: 2f0bfba5-38f6-4375-a6bf-25959ad11fe0] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:48.866008 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-ac067752-4c18-4a85-832b-fc922ad0f827 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:48.866757 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-ac067752-4c18-4a85-832b-fc922ad0f827 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:48.867755 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-ac067752-4c18-4a85-832b-fc922ad0f827 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:48.868412 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-ac067752-4c18-4a85-832b-fc922ad0f827 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:48.980570 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-caab25c6-93fe-4288-abc4-e356a993fd53 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acab2a0c4a0e48909317791a3de85b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abe012ba65845329098e0e06c54b9c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:48.990359 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-caab25c6-93fe-4288-abc4-e356a993fd53 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "GET /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5" status: 200 len: 1363 microversion: 2.1 time: 0.193024 Jan 28 02:06:48.991095 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 62/129] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:06:48 2022] GET /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5 => generated 1363 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:06:49.037214 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-ac067752-4c18-4a85-832b-fc922ad0f827 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd7039b8f074a13b2030a2bb7aaff94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc19a0f9c33f47f1b504bebbb0b2c931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:49.047413 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-ac067752-4c18-4a85-832b-fc922ad0f827 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] 10.222.0.79 "GET /compute/v2.1/servers/2f0bfba5-38f6-4375-a6bf-25959ad11fe0" status: 200 len: 1321 microversion: 2.1 time: 0.192434 Jan 28 02:06:49.050688 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 68/130] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:06:48 2022] GET /compute/v2.1/servers/2f0bfba5-38f6-4375-a6bf-25959ad11fe0 => generated 1321 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:06:49.583586 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-d9ba7831-2607-49b6-9000-5b2ea6fb3673 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:49.584340 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-d9ba7831-2607-49b6-9000-5b2ea6fb3673 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] [instance: c564cd2f-07df-4c91-9190-30cb5e9cb3ea] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:49.590580 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-d9ba7831-2607-49b6-9000-5b2ea6fb3673 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:49.591014 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-d9ba7831-2607-49b6-9000-5b2ea6fb3673 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:49.591761 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-d9ba7831-2607-49b6-9000-5b2ea6fb3673 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:49.592215 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-d9ba7831-2607-49b6-9000-5b2ea6fb3673 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:49.692928 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-14f2320a-b5df-459b-8fec-02c824ad90df tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:49.693526 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-14f2320a-b5df-459b-8fec-02c824ad90df tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:49.699441 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-14f2320a-b5df-459b-8fec-02c824ad90df tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:49.699889 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-14f2320a-b5df-459b-8fec-02c824ad90df tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:49.700696 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-14f2320a-b5df-459b-8fec-02c824ad90df tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:49.701122 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-14f2320a-b5df-459b-8fec-02c824ad90df tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:49.712013 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-d9ba7831-2607-49b6-9000-5b2ea6fb3673 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891908e1e9c8409ba9e91e341d08825e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22dd75c99404b48a867a48eb5d10c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:49.719456 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-d9ba7831-2607-49b6-9000-5b2ea6fb3673 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] 10.222.0.79 "GET /compute/v2.1/servers/c564cd2f-07df-4c91-9190-30cb5e9cb3ea" status: 200 len: 1314 microversion: 2.1 time: 0.139309 Jan 28 02:06:49.721036 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 63/131] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:06:49 2022] GET /compute/v2.1/servers/c564cd2f-07df-4c91-9190-30cb5e9cb3ea => generated 1314 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:06:49.830754 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-14f2320a-b5df-459b-8fec-02c824ad90df tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:49.838657 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-14f2320a-b5df-459b-8fec-02c824ad90df tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:49.840727 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-14f2320a-b5df-459b-8fec-02c824ad90df tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:49.841855 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-14f2320a-b5df-459b-8fec-02c824ad90df tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84" status: 200 len: 1408 microversion: 2.20 time: 0.152719 Jan 28 02:06:49.842718 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 69/132] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:06:49 2022] GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84 => generated 1408 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 02:06:50.007575 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-3afcfeec-0c10-47c7-aa72-c781c50fb9a2 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:50.008241 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-3afcfeec-0c10-47c7-aa72-c781c50fb9a2 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: d5f49055-da38-486c-9f10-1658c64d46f5] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:50.014329 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-3afcfeec-0c10-47c7-aa72-c781c50fb9a2 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:50.014772 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-3afcfeec-0c10-47c7-aa72-c781c50fb9a2 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:50.016812 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-3afcfeec-0c10-47c7-aa72-c781c50fb9a2 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:50.017943 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-3afcfeec-0c10-47c7-aa72-c781c50fb9a2 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:50.067592 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-61433523-ee40-4910-b72f-58cddae00cde tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:50.068290 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-61433523-ee40-4910-b72f-58cddae00cde tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] [instance: 2f0bfba5-38f6-4375-a6bf-25959ad11fe0] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:50.074505 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-61433523-ee40-4910-b72f-58cddae00cde tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:50.075145 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-61433523-ee40-4910-b72f-58cddae00cde tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:50.076242 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-61433523-ee40-4910-b72f-58cddae00cde tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:50.076840 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-61433523-ee40-4910-b72f-58cddae00cde tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:50.177760 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-3afcfeec-0c10-47c7-aa72-c781c50fb9a2 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acab2a0c4a0e48909317791a3de85b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abe012ba65845329098e0e06c54b9c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:50.185390 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-3afcfeec-0c10-47c7-aa72-c781c50fb9a2 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "GET /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5" status: 200 len: 1363 microversion: 2.1 time: 0.181365 Jan 28 02:06:50.185970 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 64/133] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:06:50 2022] GET /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5 => generated 1363 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:06:50.229027 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-61433523-ee40-4910-b72f-58cddae00cde tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd7039b8f074a13b2030a2bb7aaff94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc19a0f9c33f47f1b504bebbb0b2c931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:50.236822 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-61433523-ee40-4910-b72f-58cddae00cde tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] 10.222.0.79 "GET /compute/v2.1/servers/2f0bfba5-38f6-4375-a6bf-25959ad11fe0" status: 200 len: 1321 microversion: 2.1 time: 0.175302 Jan 28 02:06:50.237601 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 70/134] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:06:50 2022] GET /compute/v2.1/servers/2f0bfba5-38f6-4375-a6bf-25959ad11fe0 => generated 1321 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:06:50.737663 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-b9a22269-4313-4118-bf3e-588b67d26459 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:50.738237 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-b9a22269-4313-4118-bf3e-588b67d26459 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] [instance: c564cd2f-07df-4c91-9190-30cb5e9cb3ea] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:50.743880 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b9a22269-4313-4118-bf3e-588b67d26459 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:50.744460 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b9a22269-4313-4118-bf3e-588b67d26459 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:50.745305 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b9a22269-4313-4118-bf3e-588b67d26459 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:50.747215 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b9a22269-4313-4118-bf3e-588b67d26459 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:50.859441 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-63c6fa40-195c-4c34-98d5-536050cad332 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:50.860062 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-63c6fa40-195c-4c34-98d5-536050cad332 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:50.865702 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-63c6fa40-195c-4c34-98d5-536050cad332 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:50.866147 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-63c6fa40-195c-4c34-98d5-536050cad332 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:50.866902 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-63c6fa40-195c-4c34-98d5-536050cad332 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:50.867325 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-63c6fa40-195c-4c34-98d5-536050cad332 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:50.875267 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-b9a22269-4313-4118-bf3e-588b67d26459 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891908e1e9c8409ba9e91e341d08825e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22dd75c99404b48a867a48eb5d10c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:50.882553 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-b9a22269-4313-4118-bf3e-588b67d26459 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] 10.222.0.79 "GET /compute/v2.1/servers/c564cd2f-07df-4c91-9190-30cb5e9cb3ea" status: 200 len: 1314 microversion: 2.1 time: 0.149265 Jan 28 02:06:50.883199 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 65/135] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:06:50 2022] GET /compute/v2.1/servers/c564cd2f-07df-4c91-9190-30cb5e9cb3ea => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:06:51.031289 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-63c6fa40-195c-4c34-98d5-536050cad332 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:51.040684 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-63c6fa40-195c-4c34-98d5-536050cad332 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:51.042258 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-63c6fa40-195c-4c34-98d5-536050cad332 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:51.043455 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-63c6fa40-195c-4c34-98d5-536050cad332 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84" status: 200 len: 1408 microversion: 2.20 time: 0.187690 Jan 28 02:06:51.044193 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 71/136] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:06:50 2022] GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84 => generated 1408 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 02:06:51.202955 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-8e8a21f5-c4f5-4c70-9df5-66f7b058094d tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:51.203660 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-8e8a21f5-c4f5-4c70-9df5-66f7b058094d tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: d5f49055-da38-486c-9f10-1658c64d46f5] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:51.217877 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-8e8a21f5-c4f5-4c70-9df5-66f7b058094d tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:51.218612 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-8e8a21f5-c4f5-4c70-9df5-66f7b058094d tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:51.219521 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-8e8a21f5-c4f5-4c70-9df5-66f7b058094d tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:51.219945 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-8e8a21f5-c4f5-4c70-9df5-66f7b058094d tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:51.254408 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-d14cf404-24f2-4415-a264-11182da53670 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:51.255016 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-d14cf404-24f2-4415-a264-11182da53670 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] [instance: 2f0bfba5-38f6-4375-a6bf-25959ad11fe0] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:51.262576 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-d14cf404-24f2-4415-a264-11182da53670 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:51.263251 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-d14cf404-24f2-4415-a264-11182da53670 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:51.264822 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-d14cf404-24f2-4415-a264-11182da53670 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:51.264822 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-d14cf404-24f2-4415-a264-11182da53670 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:51.380240 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-8e8a21f5-c4f5-4c70-9df5-66f7b058094d tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acab2a0c4a0e48909317791a3de85b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abe012ba65845329098e0e06c54b9c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:51.387903 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-8e8a21f5-c4f5-4c70-9df5-66f7b058094d tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "GET /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5" status: 200 len: 1363 microversion: 2.1 time: 0.188621 Jan 28 02:06:51.397824 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 66/137] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:06:51 2022] GET /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5 => generated 1363 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:06:51.454379 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-d14cf404-24f2-4415-a264-11182da53670 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd7039b8f074a13b2030a2bb7aaff94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc19a0f9c33f47f1b504bebbb0b2c931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:51.461817 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-d14cf404-24f2-4415-a264-11182da53670 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] 10.222.0.79 "GET /compute/v2.1/servers/2f0bfba5-38f6-4375-a6bf-25959ad11fe0" status: 200 len: 1321 microversion: 2.1 time: 0.211844 Jan 28 02:06:51.462381 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 72/138] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:06:51 2022] GET /compute/v2.1/servers/2f0bfba5-38f6-4375-a6bf-25959ad11fe0 => generated 1321 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:06:51.898985 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-b34b170b-55cf-4ea4-8049-8680e9c96950 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:51.899580 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-b34b170b-55cf-4ea4-8049-8680e9c96950 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] [instance: c564cd2f-07df-4c91-9190-30cb5e9cb3ea] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:51.905255 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b34b170b-55cf-4ea4-8049-8680e9c96950 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:51.905730 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b34b170b-55cf-4ea4-8049-8680e9c96950 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:51.910626 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b34b170b-55cf-4ea4-8049-8680e9c96950 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:51.910626 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b34b170b-55cf-4ea4-8049-8680e9c96950 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:52.034458 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-b34b170b-55cf-4ea4-8049-8680e9c96950 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891908e1e9c8409ba9e91e341d08825e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22dd75c99404b48a867a48eb5d10c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:52.042370 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-b34b170b-55cf-4ea4-8049-8680e9c96950 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] 10.222.0.79 "GET /compute/v2.1/servers/c564cd2f-07df-4c91-9190-30cb5e9cb3ea" status: 200 len: 1314 microversion: 2.1 time: 0.147027 Jan 28 02:06:52.043040 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 67/139] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:06:51 2022] GET /compute/v2.1/servers/c564cd2f-07df-4c91-9190-30cb5e9cb3ea => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:06:52.062271 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-df24906d-24d1-4da2-9edc-8e1419ba151c tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:52.064983 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-df24906d-24d1-4da2-9edc-8e1419ba151c tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:52.069824 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-df24906d-24d1-4da2-9edc-8e1419ba151c tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:52.070533 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-df24906d-24d1-4da2-9edc-8e1419ba151c tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:52.071221 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-df24906d-24d1-4da2-9edc-8e1419ba151c tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:52.071644 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-df24906d-24d1-4da2-9edc-8e1419ba151c tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:52.209007 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-df24906d-24d1-4da2-9edc-8e1419ba151c tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:52.217056 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-df24906d-24d1-4da2-9edc-8e1419ba151c tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:52.218614 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-df24906d-24d1-4da2-9edc-8e1419ba151c tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:52.226147 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-df24906d-24d1-4da2-9edc-8e1419ba151c tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84" status: 200 len: 1408 microversion: 2.20 time: 0.161552 Jan 28 02:06:52.226147 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 73/140] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:06:52 2022] GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84 => generated 1408 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:06:52.408940 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-9b93b289-ac2f-45f9-9a34-aa9d18797c2e tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:52.408940 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-9b93b289-ac2f-45f9-9a34-aa9d18797c2e tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: d5f49055-da38-486c-9f10-1658c64d46f5] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:52.413452 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-9b93b289-ac2f-45f9-9a34-aa9d18797c2e tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:52.413915 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-9b93b289-ac2f-45f9-9a34-aa9d18797c2e tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:52.414848 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-9b93b289-ac2f-45f9-9a34-aa9d18797c2e tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:52.415204 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-9b93b289-ac2f-45f9-9a34-aa9d18797c2e tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:52.480753 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-550f5164-9b69-43a5-a0cf-25bdda4b40a7 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:52.481824 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-550f5164-9b69-43a5-a0cf-25bdda4b40a7 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] [instance: 2f0bfba5-38f6-4375-a6bf-25959ad11fe0] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:52.489348 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-550f5164-9b69-43a5-a0cf-25bdda4b40a7 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:52.490069 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-550f5164-9b69-43a5-a0cf-25bdda4b40a7 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:52.491119 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-550f5164-9b69-43a5-a0cf-25bdda4b40a7 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:52.491552 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-550f5164-9b69-43a5-a0cf-25bdda4b40a7 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:52.584515 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-9b93b289-ac2f-45f9-9a34-aa9d18797c2e tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acab2a0c4a0e48909317791a3de85b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abe012ba65845329098e0e06c54b9c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:52.592613 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-9b93b289-ac2f-45f9-9a34-aa9d18797c2e tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "GET /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5" status: 200 len: 1363 microversion: 2.1 time: 0.190849 Jan 28 02:06:52.593526 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 68/141] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:06:52 2022] GET /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5 => generated 1363 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:06:52.653543 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-550f5164-9b69-43a5-a0cf-25bdda4b40a7 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd7039b8f074a13b2030a2bb7aaff94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc19a0f9c33f47f1b504bebbb0b2c931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:52.661954 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-550f5164-9b69-43a5-a0cf-25bdda4b40a7 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] 10.222.0.79 "GET /compute/v2.1/servers/2f0bfba5-38f6-4375-a6bf-25959ad11fe0" status: 200 len: 1321 microversion: 2.1 time: 0.185839 Jan 28 02:06:52.662538 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 74/142] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:06:52 2022] GET /compute/v2.1/servers/2f0bfba5-38f6-4375-a6bf-25959ad11fe0 => generated 1321 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:06:53.058988 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-99cd918a-6641-4718-87be-434f54b87db1 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:53.059720 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-99cd918a-6641-4718-87be-434f54b87db1 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] [instance: c564cd2f-07df-4c91-9190-30cb5e9cb3ea] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:53.082581 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-99cd918a-6641-4718-87be-434f54b87db1 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:53.082581 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-99cd918a-6641-4718-87be-434f54b87db1 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:53.082581 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-99cd918a-6641-4718-87be-434f54b87db1 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:53.082581 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-99cd918a-6641-4718-87be-434f54b87db1 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:53.212568 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-99cd918a-6641-4718-87be-434f54b87db1 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891908e1e9c8409ba9e91e341d08825e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22dd75c99404b48a867a48eb5d10c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:53.226466 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-99cd918a-6641-4718-87be-434f54b87db1 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] 10.222.0.79 "GET /compute/v2.1/servers/c564cd2f-07df-4c91-9190-30cb5e9cb3ea" status: 200 len: 1502 microversion: 2.1 time: 0.167319 Jan 28 02:06:53.226466 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 69/143] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:06:53 2022] GET /compute/v2.1/servers/c564cd2f-07df-4c91-9190-30cb5e9cb3ea => generated 1502 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:06:53.245439 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-7f066370-b139-4405-8008-72ccb87d15ac tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:53.246037 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-7f066370-b139-4405-8008-72ccb87d15ac tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:53.260094 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-7f066370-b139-4405-8008-72ccb87d15ac tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:53.265508 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-7f066370-b139-4405-8008-72ccb87d15ac tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:53.265508 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-7f066370-b139-4405-8008-72ccb87d15ac tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:53.265508 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-7f066370-b139-4405-8008-72ccb87d15ac tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:53.396362 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-7f066370-b139-4405-8008-72ccb87d15ac tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:53.404523 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-7f066370-b139-4405-8008-72ccb87d15ac tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:53.406019 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-7f066370-b139-4405-8008-72ccb87d15ac tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:53.407136 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-7f066370-b139-4405-8008-72ccb87d15ac tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84" status: 200 len: 1408 microversion: 2.20 time: 0.165308 Jan 28 02:06:53.407805 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 75/144] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:06:53 2022] GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84 => generated 1408 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:06:53.609409 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-5b7dbe88-7bef-4def-a446-eeeeba2cc8f5 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:53.610014 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-5b7dbe88-7bef-4def-a446-eeeeba2cc8f5 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: d5f49055-da38-486c-9f10-1658c64d46f5] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:53.616975 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-5b7dbe88-7bef-4def-a446-eeeeba2cc8f5 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:53.617513 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-5b7dbe88-7bef-4def-a446-eeeeba2cc8f5 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:53.618450 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-5b7dbe88-7bef-4def-a446-eeeeba2cc8f5 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:53.618995 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-5b7dbe88-7bef-4def-a446-eeeeba2cc8f5 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:53.679055 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-6f67b4b9-75cc-44fc-a8f5-b0f633eed5d2 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:53.679666 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-6f67b4b9-75cc-44fc-a8f5-b0f633eed5d2 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] [instance: 2f0bfba5-38f6-4375-a6bf-25959ad11fe0] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:53.685635 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-6f67b4b9-75cc-44fc-a8f5-b0f633eed5d2 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:53.686301 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-6f67b4b9-75cc-44fc-a8f5-b0f633eed5d2 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:53.687246 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-6f67b4b9-75cc-44fc-a8f5-b0f633eed5d2 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:53.687843 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-6f67b4b9-75cc-44fc-a8f5-b0f633eed5d2 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:53.763951 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-5b7dbe88-7bef-4def-a446-eeeeba2cc8f5 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acab2a0c4a0e48909317791a3de85b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abe012ba65845329098e0e06c54b9c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:53.772590 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-5b7dbe88-7bef-4def-a446-eeeeba2cc8f5 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "GET /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5" status: 200 len: 1363 microversion: 2.1 time: 0.166832 Jan 28 02:06:53.773453 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 70/145] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:06:53 2022] GET /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5 => generated 1363 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:06:53.838305 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-6f67b4b9-75cc-44fc-a8f5-b0f633eed5d2 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd7039b8f074a13b2030a2bb7aaff94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc19a0f9c33f47f1b504bebbb0b2c931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:53.843103 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-6f67b4b9-75cc-44fc-a8f5-b0f633eed5d2 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] 10.222.0.79 "GET /compute/v2.1/servers/2f0bfba5-38f6-4375-a6bf-25959ad11fe0" status: 200 len: 1515 microversion: 2.1 time: 0.167864 Jan 28 02:06:53.843670 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 76/146] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:06:53 2022] GET /compute/v2.1/servers/2f0bfba5-38f6-4375-a6bf-25959ad11fe0 => generated 1515 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:06:53.864481 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-4a4845f5-c5a3-4ff4-8848-dffec01406e8 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:06:53.864481 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-4a4845f5-c5a3-4ff4-8848-dffec01406e8 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] [instance: 2f0bfba5-38f6-4375-a6bf-25959ad11fe0] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:53.867726 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-4a4845f5-c5a3-4ff4-8848-dffec01406e8 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:53.868208 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-4a4845f5-c5a3-4ff4-8848-dffec01406e8 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:53.868958 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-4a4845f5-c5a3-4ff4-8848-dffec01406e8 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:53.869379 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-4a4845f5-c5a3-4ff4-8848-dffec01406e8 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:53.934668 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.objects.instance [None req-4a4845f5-c5a3-4ff4-8848-dffec01406e8 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lazy-loading 'flavor' on Instance uuid 2f0bfba5-38f6-4375-a6bf-25959ad11fe0 {{(pid=116375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jan 28 02:06:54.257597 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-4a4845f5-c5a3-4ff4-8848-dffec01406e8 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] 10.222.0.79 "POST /compute/v2.1/servers/2f0bfba5-38f6-4375-a6bf-25959ad11fe0/action" status: 200 len: 32 microversion: 2.1 time: 0.400587 Jan 28 02:06:54.258268 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 71/147] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Jan 28 02:06:53 2022] POST /compute/v2.1/servers/2f0bfba5-38f6-4375-a6bf-25959ad11fe0/action => generated 32 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 02:06:54.267798 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-6dc67898-4be2-4606-9e91-22b93e3e6686 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:54.268462 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-6dc67898-4be2-4606-9e91-22b93e3e6686 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] [instance: 2f0bfba5-38f6-4375-a6bf-25959ad11fe0] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:54.282634 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-6dc67898-4be2-4606-9e91-22b93e3e6686 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:54.283187 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-6dc67898-4be2-4606-9e91-22b93e3e6686 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:54.284085 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-6dc67898-4be2-4606-9e91-22b93e3e6686 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:54.284534 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-6dc67898-4be2-4606-9e91-22b93e3e6686 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:54.402397 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-6dc67898-4be2-4606-9e91-22b93e3e6686 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd7039b8f074a13b2030a2bb7aaff94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc19a0f9c33f47f1b504bebbb0b2c931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:54.409707 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-6dc67898-4be2-4606-9e91-22b93e3e6686 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] 10.222.0.79 "GET /compute/v2.1/servers/2f0bfba5-38f6-4375-a6bf-25959ad11fe0" status: 200 len: 1521 microversion: 2.1 time: 0.146252 Jan 28 02:06:54.410260 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 77/148] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:06:54 2022] GET /compute/v2.1/servers/2f0bfba5-38f6-4375-a6bf-25959ad11fe0 => generated 1521 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:06:54.426659 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-500ffc12-07af-4335-a5ec-4dce54481618 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:54.427372 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-500ffc12-07af-4335-a5ec-4dce54481618 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:54.434196 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-500ffc12-07af-4335-a5ec-4dce54481618 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:54.434641 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-500ffc12-07af-4335-a5ec-4dce54481618 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:54.435397 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-500ffc12-07af-4335-a5ec-4dce54481618 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:54.435827 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-500ffc12-07af-4335-a5ec-4dce54481618 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:54.557408 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-500ffc12-07af-4335-a5ec-4dce54481618 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:54.565758 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-500ffc12-07af-4335-a5ec-4dce54481618 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:54.567324 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-500ffc12-07af-4335-a5ec-4dce54481618 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:54.568445 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-500ffc12-07af-4335-a5ec-4dce54481618 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84" status: 200 len: 1598 microversion: 2.20 time: 0.145938 Jan 28 02:06:54.569002 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 72/149] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:06:54 2022] GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84 => generated 1598 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:06:54.586564 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-05372997-a807-4a98-8e04-7f3e28811c5b tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:54.587053 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-05372997-a807-4a98-8e04-7f3e28811c5b tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:54.593163 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-05372997-a807-4a98-8e04-7f3e28811c5b tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:54.593521 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-05372997-a807-4a98-8e04-7f3e28811c5b tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:54.594318 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-05372997-a807-4a98-8e04-7f3e28811c5b tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:54.594750 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-05372997-a807-4a98-8e04-7f3e28811c5b tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:54.710588 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-05372997-a807-4a98-8e04-7f3e28811c5b tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.127614 Jan 28 02:06:54.711177 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 78/150] 10.222.0.79 () {60 vars in 1315 bytes} [Fri Jan 28 02:06:54 2022] GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84/os-interface => generated 284 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 02:06:54.789541 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-fa65e8e6-f0b7-45ab-876a-d2abf3fcd888 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:54.790435 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-fa65e8e6-f0b7-45ab-876a-d2abf3fcd888 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: d5f49055-da38-486c-9f10-1658c64d46f5] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:54.796457 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-fa65e8e6-f0b7-45ab-876a-d2abf3fcd888 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:54.796900 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-fa65e8e6-f0b7-45ab-876a-d2abf3fcd888 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:54.797662 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-fa65e8e6-f0b7-45ab-876a-d2abf3fcd888 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:54.798717 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-fa65e8e6-f0b7-45ab-876a-d2abf3fcd888 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:55.070484 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-fa65e8e6-f0b7-45ab-876a-d2abf3fcd888 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acab2a0c4a0e48909317791a3de85b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abe012ba65845329098e0e06c54b9c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:55.077886 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-fa65e8e6-f0b7-45ab-876a-d2abf3fcd888 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "GET /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5" status: 200 len: 1363 microversion: 2.1 time: 0.291966 Jan 28 02:06:55.078621 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 73/151] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:06:54 2022] GET /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5 => generated 1363 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:06:55.428281 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-eb739439-be7a-41fc-8c81-0a17e7ee379f tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:55.428947 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-eb739439-be7a-41fc-8c81-0a17e7ee379f tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] [instance: 2f0bfba5-38f6-4375-a6bf-25959ad11fe0] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:55.435767 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-eb739439-be7a-41fc-8c81-0a17e7ee379f tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:55.436248 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-eb739439-be7a-41fc-8c81-0a17e7ee379f tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:55.437052 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-eb739439-be7a-41fc-8c81-0a17e7ee379f tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:55.437473 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-eb739439-be7a-41fc-8c81-0a17e7ee379f tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:55.773280 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-eb739439-be7a-41fc-8c81-0a17e7ee379f tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd7039b8f074a13b2030a2bb7aaff94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc19a0f9c33f47f1b504bebbb0b2c931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:55.780455 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-eb739439-be7a-41fc-8c81-0a17e7ee379f tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] 10.222.0.79 "GET /compute/v2.1/servers/2f0bfba5-38f6-4375-a6bf-25959ad11fe0" status: 200 len: 1521 microversion: 2.1 time: 0.357295 Jan 28 02:06:55.781019 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 79/152] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:06:55 2022] GET /compute/v2.1/servers/2f0bfba5-38f6-4375-a6bf-25959ad11fe0 => generated 1521 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:06:55.938541 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [req-96a75e35-f640-412d-91db-04e56955c58b req-63ed5871-c8bd-4dcd-b6db-5afed3e59be0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5f49055-da38-486c-9f10-1658c64d46f5", "name": "network-vif-plugged", "status": "completed", "tag": "66c0ebdc-a262-49e8-983e-2b45feca212a"}]} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:06:55.942094 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:06:55.942094 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: warnings.warn(msg) Jan 28 02:06:55.949102 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-96a75e35-f640-412d-91db-04e56955c58b req-63ed5871-c8bd-4dcd-b6db-5afed3e59be0 service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:55.949538 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-96a75e35-f640-412d-91db-04e56955c58b req-63ed5871-c8bd-4dcd-b6db-5afed3e59be0 service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:55.960902 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.compute.server_external_events [req-96a75e35-f640-412d-91db-04e56955c58b req-63ed5871-c8bd-4dcd-b6db-5afed3e59be0 service nova] Creating event network-vif-plugged:66c0ebdc-a262-49e8-983e-2b45feca212a for instance d5f49055-da38-486c-9f10-1658c64d46f5 on hv-cinder-82497 Jan 28 02:06:55.965848 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [req-96a75e35-f640-412d-91db-04e56955c58b req-63ed5871-c8bd-4dcd-b6db-5afed3e59be0 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032872 Jan 28 02:06:55.966610 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 74/153] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Jan 28 02:06:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 02:06:56.102370 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-0a4ae0b5-e725-4839-a668-76df5b8db468 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:56.102990 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-0a4ae0b5-e725-4839-a668-76df5b8db468 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: d5f49055-da38-486c-9f10-1658c64d46f5] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:56.108840 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-0a4ae0b5-e725-4839-a668-76df5b8db468 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:56.109287 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-0a4ae0b5-e725-4839-a668-76df5b8db468 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:56.110062 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-0a4ae0b5-e725-4839-a668-76df5b8db468 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:56.110493 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-0a4ae0b5-e725-4839-a668-76df5b8db468 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:56.328223 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-0a4ae0b5-e725-4839-a668-76df5b8db468 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acab2a0c4a0e48909317791a3de85b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abe012ba65845329098e0e06c54b9c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:56.333722 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-fa62ec80-ba7b-46e7-8961-afa69c38c34a tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:06:56.334714 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-fa62ec80-ba7b-46e7-8961-afa69c38c34a tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:56.341206 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-fa62ec80-ba7b-46e7-8961-afa69c38c34a tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:56.341813 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-fa62ec80-ba7b-46e7-8961-afa69c38c34a tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:56.342589 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-fa62ec80-ba7b-46e7-8961-afa69c38c34a tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:56.343030 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-fa62ec80-ba7b-46e7-8961-afa69c38c34a tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:56.344298 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-0a4ae0b5-e725-4839-a668-76df5b8db468 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "GET /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5" status: 200 len: 1363 microversion: 2.1 time: 0.251652 Jan 28 02:06:56.345134 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 80/154] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:06:56 2022] GET /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5 => generated 1363 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:06:56.358582 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [req-2ef1799e-b59c-4c94-bde8-c0c463fe39c0 req-880fc856-82c7-415d-9a75-601a28533ccb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f25403b-0399-48d0-86a9-6e5022287c84", "tag": "eb8f729a-b66f-4c5c-a62e-472c346922bb"}]} {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:06:56.360176 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:06:56.360176 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: warnings.warn(msg) Jan 28 02:06:56.367577 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [req-2ef1799e-b59c-4c94-bde8-c0c463fe39c0 req-880fc856-82c7-415d-9a75-601a28533ccb service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:56.368049 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [req-2ef1799e-b59c-4c94-bde8-c0c463fe39c0 req-880fc856-82c7-415d-9a75-601a28533ccb service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:56.380706 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.compute.server_external_events [req-2ef1799e-b59c-4c94-bde8-c0c463fe39c0 req-880fc856-82c7-415d-9a75-601a28533ccb service nova] Creating event network-changed:eb8f729a-b66f-4c5c-a62e-472c346922bb for instance 4f25403b-0399-48d0-86a9-6e5022287c84 on hv-cinder-82497 Jan 28 02:06:56.385965 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [req-2ef1799e-b59c-4c94-bde8-c0c463fe39c0 req-880fc856-82c7-415d-9a75-601a28533ccb service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030917 Jan 28 02:06:56.386754 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 81/155] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Jan 28 02:06:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:06:56.797833 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-51a892c4-fdb6-475a-bde0-ba1e18bce3fb tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:56.799327 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-51a892c4-fdb6-475a-bde0-ba1e18bce3fb tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] [instance: 2f0bfba5-38f6-4375-a6bf-25959ad11fe0] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:56.805546 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-51a892c4-fdb6-475a-bde0-ba1e18bce3fb tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:56.805999 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-51a892c4-fdb6-475a-bde0-ba1e18bce3fb tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:56.806771 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-51a892c4-fdb6-475a-bde0-ba1e18bce3fb tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:56.807196 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-51a892c4-fdb6-475a-bde0-ba1e18bce3fb tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:56.942574 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-51a892c4-fdb6-475a-bde0-ba1e18bce3fb tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd7039b8f074a13b2030a2bb7aaff94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc19a0f9c33f47f1b504bebbb0b2c931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:56.969486 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-51a892c4-fdb6-475a-bde0-ba1e18bce3fb tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] 10.222.0.79 "GET /compute/v2.1/servers/2f0bfba5-38f6-4375-a6bf-25959ad11fe0" status: 200 len: 1521 microversion: 2.1 time: 0.175526 Jan 28 02:06:56.970220 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 82/156] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:06:56 2022] GET /compute/v2.1/servers/2f0bfba5-38f6-4375-a6bf-25959ad11fe0 => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:06:57.118674 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-fa62ec80-ba7b-46e7-8961-afa69c38c34a tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "POST /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84/action" status: 200 len: 14 microversion: 2.20 time: 0.789069 Jan 28 02:06:57.120504 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 75/157] 10.222.0.79 () {62 vars in 1318 bytes} [Fri Jan 28 02:06:56 2022] POST /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84/action => generated 14 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:06:57.360259 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-9a16406a-6c76-4cdd-80df-77229318ec3b tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:57.361079 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-9a16406a-6c76-4cdd-80df-77229318ec3b tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: d5f49055-da38-486c-9f10-1658c64d46f5] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:57.370784 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-9a16406a-6c76-4cdd-80df-77229318ec3b tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:57.380504 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-9a16406a-6c76-4cdd-80df-77229318ec3b tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:57.381483 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-9a16406a-6c76-4cdd-80df-77229318ec3b tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:57.381933 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-9a16406a-6c76-4cdd-80df-77229318ec3b tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:57.611907 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-9a16406a-6c76-4cdd-80df-77229318ec3b tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acab2a0c4a0e48909317791a3de85b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abe012ba65845329098e0e06c54b9c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:57.619323 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-9a16406a-6c76-4cdd-80df-77229318ec3b tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "GET /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5" status: 200 len: 1363 microversion: 2.1 time: 0.262637 Jan 28 02:06:57.619894 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 83/158] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:06:57 2022] GET /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5 => generated 1363 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:06:57.988379 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-536fc502-eb04-49da-9d43-7e5e6c13d3d8 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:57.989441 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-536fc502-eb04-49da-9d43-7e5e6c13d3d8 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] [instance: 2f0bfba5-38f6-4375-a6bf-25959ad11fe0] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:57.996468 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-536fc502-eb04-49da-9d43-7e5e6c13d3d8 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:57.997212 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-536fc502-eb04-49da-9d43-7e5e6c13d3d8 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:57.998244 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-536fc502-eb04-49da-9d43-7e5e6c13d3d8 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:57.999241 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-536fc502-eb04-49da-9d43-7e5e6c13d3d8 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:58.135959 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-569b88e8-79a4-4b08-9c6a-40d2d7f40a09 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:06:58.135959 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-569b88e8-79a4-4b08-9c6a-40d2d7f40a09 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:58.139663 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-569b88e8-79a4-4b08-9c6a-40d2d7f40a09 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:58.140426 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-569b88e8-79a4-4b08-9c6a-40d2d7f40a09 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:58.141433 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-569b88e8-79a4-4b08-9c6a-40d2d7f40a09 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:58.143439 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-569b88e8-79a4-4b08-9c6a-40d2d7f40a09 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:58.366127 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-569b88e8-79a4-4b08-9c6a-40d2d7f40a09 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "POST /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84/action" status: 200 len: 14 microversion: 2.20 time: 0.238863 Jan 28 02:06:58.369755 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 84/159] 10.222.0.79 () {62 vars in 1318 bytes} [Fri Jan 28 02:06:58 2022] POST /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84/action => generated 14 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:06:58.369909 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-536fc502-eb04-49da-9d43-7e5e6c13d3d8 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd7039b8f074a13b2030a2bb7aaff94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc19a0f9c33f47f1b504bebbb0b2c931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:58.379047 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-536fc502-eb04-49da-9d43-7e5e6c13d3d8 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] 10.222.0.79 "GET /compute/v2.1/servers/2f0bfba5-38f6-4375-a6bf-25959ad11fe0" status: 200 len: 1521 microversion: 2.1 time: 0.393590 Jan 28 02:06:58.380587 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 76/160] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:06:57 2022] GET /compute/v2.1/servers/2f0bfba5-38f6-4375-a6bf-25959ad11fe0 => generated 1521 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:06:58.393505 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-dc0d0ff0-5d1e-4608-b109-0610628ec007 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ff200797-ad75-4047-a31e-987ff8b2886a"}} {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:06:58.394214 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-dc0d0ff0-5d1e-4608-b109-0610628ec007 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] [instance: c564cd2f-07df-4c91-9190-30cb5e9cb3ea] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:58.402790 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-dc0d0ff0-5d1e-4608-b109-0610628ec007 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:58.403373 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-dc0d0ff0-5d1e-4608-b109-0610628ec007 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:58.404313 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-dc0d0ff0-5d1e-4608-b109-0610628ec007 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:58.404848 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-dc0d0ff0-5d1e-4608-b109-0610628ec007 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:58.640012 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-1b1f8bf6-4b21-4a98-a878-5768d0e42e91 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:58.641516 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-1b1f8bf6-4b21-4a98-a878-5768d0e42e91 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: d5f49055-da38-486c-9f10-1658c64d46f5] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:58.649858 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-1b1f8bf6-4b21-4a98-a878-5768d0e42e91 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:58.652527 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-1b1f8bf6-4b21-4a98-a878-5768d0e42e91 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:58.654951 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-1b1f8bf6-4b21-4a98-a878-5768d0e42e91 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:58.654951 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-1b1f8bf6-4b21-4a98-a878-5768d0e42e91 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:58.819645 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-1b1f8bf6-4b21-4a98-a878-5768d0e42e91 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acab2a0c4a0e48909317791a3de85b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abe012ba65845329098e0e06c54b9c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:58.828096 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-1b1f8bf6-4b21-4a98-a878-5768d0e42e91 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "GET /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5" status: 200 len: 1363 microversion: 2.1 time: 0.194359 Jan 28 02:06:58.828671 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 77/161] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:06:58 2022] GET /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5 => generated 1363 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:06:59.377696 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-b8232325-0651-42f2-8434-e36c7a6dd8c3 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:06:59.381486 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-b8232325-0651-42f2-8434-e36c7a6dd8c3 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:59.385180 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b8232325-0651-42f2-8434-e36c7a6dd8c3 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:59.385707 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b8232325-0651-42f2-8434-e36c7a6dd8c3 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:59.386630 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b8232325-0651-42f2-8434-e36c7a6dd8c3 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:59.387062 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b8232325-0651-42f2-8434-e36c7a6dd8c3 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:59.555571 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-b8232325-0651-42f2-8434-e36c7a6dd8c3 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "POST /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84/action" status: 200 len: 14 microversion: 2.20 time: 0.181452 Jan 28 02:06:59.558937 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 78/162] 10.222.0.79 () {62 vars in 1318 bytes} [Fri Jan 28 02:06:59 2022] POST /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84/action => generated 14 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:06:59.570536 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-b5c472f3-59b9-4197-a4c5-ede6d971cfc9 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:59.571220 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-b5c472f3-59b9-4197-a4c5-ede6d971cfc9 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] [instance: 2f0bfba5-38f6-4375-a6bf-25959ad11fe0] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:59.578300 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b5c472f3-59b9-4197-a4c5-ede6d971cfc9 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:59.578748 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b5c472f3-59b9-4197-a4c5-ede6d971cfc9 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:59.579526 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b5c472f3-59b9-4197-a4c5-ede6d971cfc9 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:59.583077 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b5c472f3-59b9-4197-a4c5-ede6d971cfc9 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:59.720722 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-b5c472f3-59b9-4197-a4c5-ede6d971cfc9 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd7039b8f074a13b2030a2bb7aaff94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc19a0f9c33f47f1b504bebbb0b2c931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:06:59.728191 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-b5c472f3-59b9-4197-a4c5-ede6d971cfc9 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] 10.222.0.79 "GET /compute/v2.1/servers/2f0bfba5-38f6-4375-a6bf-25959ad11fe0" status: 200 len: 1521 microversion: 2.1 time: 0.161539 Jan 28 02:06:59.729016 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 79/163] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:06:59 2022] GET /compute/v2.1/servers/2f0bfba5-38f6-4375-a6bf-25959ad11fe0 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:06:59.757835 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-dc0d0ff0-5d1e-4608-b109-0610628ec007 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] 10.222.0.79 "POST /compute/v2.1/servers/c564cd2f-07df-4c91-9190-30cb5e9cb3ea/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.385189 Jan 28 02:06:59.758487 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 85/164] 10.222.0.79 () {60 vars in 1322 bytes} [Fri Jan 28 02:06:58 2022] POST /compute/v2.1/servers/c564cd2f-07df-4c91-9190-30cb5e9cb3ea/os-volume_attachments => generated 194 bytes in 1387 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:06:59.845922 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-a510aab6-024b-420f-9386-9ee801acdf53 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:06:59.846751 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-a510aab6-024b-420f-9386-9ee801acdf53 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: d5f49055-da38-486c-9f10-1658c64d46f5] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:06:59.853517 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a510aab6-024b-420f-9386-9ee801acdf53 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:59.854073 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a510aab6-024b-420f-9386-9ee801acdf53 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:06:59.854929 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a510aab6-024b-420f-9386-9ee801acdf53 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:06:59.855590 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a510aab6-024b-420f-9386-9ee801acdf53 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:00.040184 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-a510aab6-024b-420f-9386-9ee801acdf53 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acab2a0c4a0e48909317791a3de85b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abe012ba65845329098e0e06c54b9c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:00.047833 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-a510aab6-024b-420f-9386-9ee801acdf53 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "GET /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5" status: 200 len: 1549 microversion: 2.1 time: 0.205888 Jan 28 02:07:00.048535 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 80/165] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:06:59 2022] GET /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5 => generated 1549 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:07:00.067356 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-8c05f3ea-7e6d-4c10-bc37-0eadf4406a63 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:07:00.068056 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-8c05f3ea-7e6d-4c10-bc37-0eadf4406a63 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: d5f49055-da38-486c-9f10-1658c64d46f5] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:00.076920 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-8c05f3ea-7e6d-4c10-bc37-0eadf4406a63 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:00.077361 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-8c05f3ea-7e6d-4c10-bc37-0eadf4406a63 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:00.078139 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-8c05f3ea-7e6d-4c10-bc37-0eadf4406a63 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:00.078550 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-8c05f3ea-7e6d-4c10-bc37-0eadf4406a63 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:00.160816 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-8c05f3ea-7e6d-4c10-bc37-0eadf4406a63 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "GET /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.098964 Jan 28 02:07:00.161632 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 86/166] 10.222.0.79 () {58 vars in 1274 bytes} [Fri Jan 28 02:07:00 2022] GET /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5/os-interface => generated 285 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 02:07:00.566857 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-98d37db3-663c-4d83-9c33-ac72d2d3bd55 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:07:00.568492 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-98d37db3-663c-4d83-9c33-ac72d2d3bd55 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:00.575185 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-98d37db3-663c-4d83-9c33-ac72d2d3bd55 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:00.575644 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-98d37db3-663c-4d83-9c33-ac72d2d3bd55 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:00.576433 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-98d37db3-663c-4d83-9c33-ac72d2d3bd55 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:00.576864 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-98d37db3-663c-4d83-9c33-ac72d2d3bd55 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:00.693189 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-98d37db3-663c-4d83-9c33-ac72d2d3bd55 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "POST /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84/action" status: 200 len: 14 microversion: 2.20 time: 0.129313 Jan 28 02:07:00.696132 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 81/167] 10.222.0.79 () {62 vars in 1318 bytes} [Fri Jan 28 02:07:00 2022] POST /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84/action => generated 14 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:07:00.745034 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-bf49e0bb-3abe-4292-9ed0-37be28f2766a tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:07:00.745754 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-bf49e0bb-3abe-4292-9ed0-37be28f2766a tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] [instance: 2f0bfba5-38f6-4375-a6bf-25959ad11fe0] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:00.751411 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-bf49e0bb-3abe-4292-9ed0-37be28f2766a tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:00.768157 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-bf49e0bb-3abe-4292-9ed0-37be28f2766a tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:00.768157 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-bf49e0bb-3abe-4292-9ed0-37be28f2766a tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:00.768157 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-bf49e0bb-3abe-4292-9ed0-37be28f2766a tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:00.898553 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-bf49e0bb-3abe-4292-9ed0-37be28f2766a tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd7039b8f074a13b2030a2bb7aaff94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc19a0f9c33f47f1b504bebbb0b2c931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:00.906205 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-bf49e0bb-3abe-4292-9ed0-37be28f2766a tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] 10.222.0.79 "GET /compute/v2.1/servers/2f0bfba5-38f6-4375-a6bf-25959ad11fe0" status: 200 len: 1521 microversion: 2.1 time: 0.165012 Jan 28 02:07:00.907049 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 87/168] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:07:00 2022] GET /compute/v2.1/servers/2f0bfba5-38f6-4375-a6bf-25959ad11fe0 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:07:01.703483 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-014c26e0-7756-4442-8d8c-11abcf86b199 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:07:01.704594 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-014c26e0-7756-4442-8d8c-11abcf86b199 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:01.716571 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-3aa38f04-2477-46a6-8c79-0d256fab63b6 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:07:01.717607 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-3aa38f04-2477-46a6-8c79-0d256fab63b6 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: d5f49055-da38-486c-9f10-1658c64d46f5] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:01.723295 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-014c26e0-7756-4442-8d8c-11abcf86b199 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:01.724208 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-014c26e0-7756-4442-8d8c-11abcf86b199 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:01.725196 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-3aa38f04-2477-46a6-8c79-0d256fab63b6 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:01.725588 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-3aa38f04-2477-46a6-8c79-0d256fab63b6 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:01.725893 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-014c26e0-7756-4442-8d8c-11abcf86b199 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:01.726381 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-3aa38f04-2477-46a6-8c79-0d256fab63b6 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:01.726650 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-014c26e0-7756-4442-8d8c-11abcf86b199 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:01.727127 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-3aa38f04-2477-46a6-8c79-0d256fab63b6 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:03.969059 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-3aa38f04-2477-46a6-8c79-0d256fab63b6 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "POST /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5/action" status: 200 len: 14 microversion: 2.1 time: 2.256190 Jan 28 02:07:03.969709 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 88/169] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Jan 28 02:07:01 2022] POST /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5/action => generated 14 bytes in 2258 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 02:07:03.974700 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [req-1fc20b6b-2322-4c46-8ef0-15fdcf7d6e0f req-b86540dc-2551-4c4a-a724-45a13f1402f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5f49055-da38-486c-9f10-1658c64d46f5", "tag": "66c0ebdc-a262-49e8-983e-2b45feca212a"}]} {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:07:03.976215 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:07:03.976215 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: warnings.warn(msg) Jan 28 02:07:03.984483 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [req-1fc20b6b-2322-4c46-8ef0-15fdcf7d6e0f req-b86540dc-2551-4c4a-a724-45a13f1402f0 service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:03.984912 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [req-1fc20b6b-2322-4c46-8ef0-15fdcf7d6e0f req-b86540dc-2551-4c4a-a724-45a13f1402f0 service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:03.996646 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.compute.server_external_events [req-1fc20b6b-2322-4c46-8ef0-15fdcf7d6e0f req-b86540dc-2551-4c4a-a724-45a13f1402f0 service nova] Creating event network-changed:66c0ebdc-a262-49e8-983e-2b45feca212a for instance d5f49055-da38-486c-9f10-1658c64d46f5 on hv-cinder-82497 Jan 28 02:07:04.001799 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [req-1fc20b6b-2322-4c46-8ef0-15fdcf7d6e0f req-b86540dc-2551-4c4a-a724-45a13f1402f0 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030716 Jan 28 02:07:04.002457 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 89/170] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Jan 28 02:07:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:07:04.008511 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-f8aee594-9596-4014-86fa-4c062e2a960f tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:07:04.009375 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-f8aee594-9596-4014-86fa-4c062e2a960f tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] [instance: 2f0bfba5-38f6-4375-a6bf-25959ad11fe0] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:04.012666 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-014c26e0-7756-4442-8d8c-11abcf86b199 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "POST /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84/action" status: 200 len: 14 microversion: 2.20 time: 2.312980 Jan 28 02:07:04.016110 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 82/171] 10.222.0.79 () {62 vars in 1318 bytes} [Fri Jan 28 02:07:01 2022] POST /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84/action => generated 14 bytes in 2315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:07:04.016240 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-f8aee594-9596-4014-86fa-4c062e2a960f tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:04.016511 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-f8aee594-9596-4014-86fa-4c062e2a960f tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:04.017377 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-f8aee594-9596-4014-86fa-4c062e2a960f tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:04.017814 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-f8aee594-9596-4014-86fa-4c062e2a960f tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:04.224136 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-f8aee594-9596-4014-86fa-4c062e2a960f tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd7039b8f074a13b2030a2bb7aaff94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc19a0f9c33f47f1b504bebbb0b2c931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:04.231673 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-f8aee594-9596-4014-86fa-4c062e2a960f tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] 10.222.0.79 "GET /compute/v2.1/servers/2f0bfba5-38f6-4375-a6bf-25959ad11fe0" status: 200 len: 1521 microversion: 2.1 time: 0.227283 Jan 28 02:07:04.232386 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 90/172] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:07:04 2022] GET /compute/v2.1/servers/2f0bfba5-38f6-4375-a6bf-25959ad11fe0 => generated 1521 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:07:04.980850 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-dd8f259d-6fe1-48bb-b893-b8938176d060 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:07:04.981871 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-dd8f259d-6fe1-48bb-b893-b8938176d060 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: d5f49055-da38-486c-9f10-1658c64d46f5] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:04.988579 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-dd8f259d-6fe1-48bb-b893-b8938176d060 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:04.988921 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-dd8f259d-6fe1-48bb-b893-b8938176d060 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:04.989677 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-dd8f259d-6fe1-48bb-b893-b8938176d060 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:04.990104 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-dd8f259d-6fe1-48bb-b893-b8938176d060 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:05.023298 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-f6a4d4c3-c54e-4e32-95d9-ce4bacc8b123 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:07:05.024261 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-f6a4d4c3-c54e-4e32-95d9-ce4bacc8b123 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:05.030476 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-f6a4d4c3-c54e-4e32-95d9-ce4bacc8b123 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:05.030922 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-f6a4d4c3-c54e-4e32-95d9-ce4bacc8b123 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:05.031686 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-f6a4d4c3-c54e-4e32-95d9-ce4bacc8b123 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:05.032149 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-f6a4d4c3-c54e-4e32-95d9-ce4bacc8b123 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:05.131120 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-dd8f259d-6fe1-48bb-b893-b8938176d060 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "POST /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5/action" status: 200 len: 14 microversion: 2.1 time: 0.154487 Jan 28 02:07:05.131928 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 83/173] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Jan 28 02:07:04 2022] POST /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5/action => generated 14 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 02:07:05.171510 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-f6a4d4c3-c54e-4e32-95d9-ce4bacc8b123 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "POST /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84/action" status: 200 len: 14 microversion: 2.20 time: 0.151978 Jan 28 02:07:05.172243 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 91/174] 10.222.0.79 () {62 vars in 1318 bytes} [Fri Jan 28 02:07:05 2022] POST /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84/action => generated 14 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:07:05.255401 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-a3900de7-7979-4953-880f-a482c7a9d1c0 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:07:05.261069 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-a3900de7-7979-4953-880f-a482c7a9d1c0 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] [instance: 2f0bfba5-38f6-4375-a6bf-25959ad11fe0] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:05.266723 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a3900de7-7979-4953-880f-a482c7a9d1c0 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:05.267525 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a3900de7-7979-4953-880f-a482c7a9d1c0 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:05.268602 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a3900de7-7979-4953-880f-a482c7a9d1c0 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:05.269330 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a3900de7-7979-4953-880f-a482c7a9d1c0 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:05.424419 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-a3900de7-7979-4953-880f-a482c7a9d1c0 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd7039b8f074a13b2030a2bb7aaff94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc19a0f9c33f47f1b504bebbb0b2c931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:05.432600 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-a3900de7-7979-4953-880f-a482c7a9d1c0 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] 10.222.0.79 "GET /compute/v2.1/servers/2f0bfba5-38f6-4375-a6bf-25959ad11fe0" status: 200 len: 1521 microversion: 2.1 time: 0.186501 Jan 28 02:07:05.433162 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 84/175] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:07:05 2022] GET /compute/v2.1/servers/2f0bfba5-38f6-4375-a6bf-25959ad11fe0 => generated 1521 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:07:06.143003 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-51faf473-a22f-45fc-914b-1b477c990deb tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:07:06.143965 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-51faf473-a22f-45fc-914b-1b477c990deb tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: d5f49055-da38-486c-9f10-1658c64d46f5] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:06.151164 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-51faf473-a22f-45fc-914b-1b477c990deb tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:06.151619 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-51faf473-a22f-45fc-914b-1b477c990deb tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:06.152793 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-51faf473-a22f-45fc-914b-1b477c990deb tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:06.153275 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-51faf473-a22f-45fc-914b-1b477c990deb tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:06.184886 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-d0deed54-25d9-4d61-be91-55e6efb9ee86 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:07:06.186958 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-d0deed54-25d9-4d61-be91-55e6efb9ee86 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:06.194681 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-d0deed54-25d9-4d61-be91-55e6efb9ee86 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:06.195192 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-d0deed54-25d9-4d61-be91-55e6efb9ee86 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:06.196111 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-d0deed54-25d9-4d61-be91-55e6efb9ee86 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:06.196609 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-d0deed54-25d9-4d61-be91-55e6efb9ee86 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:06.319413 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-51faf473-a22f-45fc-914b-1b477c990deb tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "POST /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5/action" status: 200 len: 14 microversion: 2.1 time: 0.180460 Jan 28 02:07:06.320103 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 92/176] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Jan 28 02:07:06 2022] POST /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5/action => generated 14 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 02:07:06.345630 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-d0deed54-25d9-4d61-be91-55e6efb9ee86 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "POST /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84/action" status: 200 len: 14 microversion: 2.20 time: 0.165310 Jan 28 02:07:06.346820 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 85/177] 10.222.0.79 () {62 vars in 1318 bytes} [Fri Jan 28 02:07:06 2022] POST /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84/action => generated 14 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:07:06.453775 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-8ad965d1-d3e3-4ace-9e9b-b519f68e3e65 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:07:06.454472 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-8ad965d1-d3e3-4ace-9e9b-b519f68e3e65 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] [instance: 2f0bfba5-38f6-4375-a6bf-25959ad11fe0] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:06.461121 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-8ad965d1-d3e3-4ace-9e9b-b519f68e3e65 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:06.461576 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-8ad965d1-d3e3-4ace-9e9b-b519f68e3e65 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:06.462364 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-8ad965d1-d3e3-4ace-9e9b-b519f68e3e65 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:06.462803 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-8ad965d1-d3e3-4ace-9e9b-b519f68e3e65 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:06.604091 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-8ad965d1-d3e3-4ace-9e9b-b519f68e3e65 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd7039b8f074a13b2030a2bb7aaff94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc19a0f9c33f47f1b504bebbb0b2c931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:06.611624 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-8ad965d1-d3e3-4ace-9e9b-b519f68e3e65 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] 10.222.0.79 "GET /compute/v2.1/servers/2f0bfba5-38f6-4375-a6bf-25959ad11fe0" status: 200 len: 1521 microversion: 2.1 time: 0.161953 Jan 28 02:07:06.612383 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 93/178] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:07:06 2022] GET /compute/v2.1/servers/2f0bfba5-38f6-4375-a6bf-25959ad11fe0 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:07:07.331595 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-6908e18b-0c31-4455-9af4-b8b223a0a943 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:07:07.332987 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-6908e18b-0c31-4455-9af4-b8b223a0a943 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: d5f49055-da38-486c-9f10-1658c64d46f5] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:07.339371 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-6908e18b-0c31-4455-9af4-b8b223a0a943 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:07.339807 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-6908e18b-0c31-4455-9af4-b8b223a0a943 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:07.340882 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-6908e18b-0c31-4455-9af4-b8b223a0a943 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:07.341304 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-6908e18b-0c31-4455-9af4-b8b223a0a943 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:07.356452 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-23a49d54-f491-496b-b070-100f54d9a632 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:07:07.357362 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-23a49d54-f491-496b-b070-100f54d9a632 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:07.363097 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-23a49d54-f491-496b-b070-100f54d9a632 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:07.364348 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-23a49d54-f491-496b-b070-100f54d9a632 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:07.365120 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-23a49d54-f491-496b-b070-100f54d9a632 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:07.365540 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-23a49d54-f491-496b-b070-100f54d9a632 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:07.471195 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-6908e18b-0c31-4455-9af4-b8b223a0a943 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "POST /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5/action" status: 200 len: 14 microversion: 2.1 time: 0.144049 Jan 28 02:07:07.471804 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 86/179] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Jan 28 02:07:07 2022] POST /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5/action => generated 14 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 02:07:07.507675 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-23a49d54-f491-496b-b070-100f54d9a632 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "POST /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84/action" status: 200 len: 14 microversion: 2.20 time: 0.154558 Jan 28 02:07:07.508487 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 94/180] 10.222.0.79 () {62 vars in 1318 bytes} [Fri Jan 28 02:07:07 2022] POST /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84/action => generated 14 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:07:07.631850 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-8551e0c0-a7a1-4aa6-b1f8-b6e2d27e2bf5 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:07:07.632578 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-8551e0c0-a7a1-4aa6-b1f8-b6e2d27e2bf5 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] [instance: 2f0bfba5-38f6-4375-a6bf-25959ad11fe0] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:07.639218 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-8551e0c0-a7a1-4aa6-b1f8-b6e2d27e2bf5 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:07.639665 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-8551e0c0-a7a1-4aa6-b1f8-b6e2d27e2bf5 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:07.640459 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-8551e0c0-a7a1-4aa6-b1f8-b6e2d27e2bf5 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:07.640892 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-8551e0c0-a7a1-4aa6-b1f8-b6e2d27e2bf5 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:07.766718 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-8551e0c0-a7a1-4aa6-b1f8-b6e2d27e2bf5 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd7039b8f074a13b2030a2bb7aaff94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc19a0f9c33f47f1b504bebbb0b2c931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:07.775214 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-8551e0c0-a7a1-4aa6-b1f8-b6e2d27e2bf5 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] 10.222.0.79 "GET /compute/v2.1/servers/2f0bfba5-38f6-4375-a6bf-25959ad11fe0" status: 200 len: 1521 microversion: 2.1 time: 0.149393 Jan 28 02:07:07.776040 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 87/181] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:07:07 2022] GET /compute/v2.1/servers/2f0bfba5-38f6-4375-a6bf-25959ad11fe0 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:07:08.482428 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-72ec4979-b0cf-4540-a9d3-2ec0b708e755 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:07:08.483560 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-72ec4979-b0cf-4540-a9d3-2ec0b708e755 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: d5f49055-da38-486c-9f10-1658c64d46f5] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:08.489881 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-72ec4979-b0cf-4540-a9d3-2ec0b708e755 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:08.490372 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-72ec4979-b0cf-4540-a9d3-2ec0b708e755 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:08.491082 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-72ec4979-b0cf-4540-a9d3-2ec0b708e755 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:08.491507 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-72ec4979-b0cf-4540-a9d3-2ec0b708e755 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:08.519122 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-5a60cccb-50f9-4575-af7d-4e220a29a62a tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:07:08.521394 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-5a60cccb-50f9-4575-af7d-4e220a29a62a tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:08.529185 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-5a60cccb-50f9-4575-af7d-4e220a29a62a tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:08.529635 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-5a60cccb-50f9-4575-af7d-4e220a29a62a tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:08.530420 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-5a60cccb-50f9-4575-af7d-4e220a29a62a tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:08.530866 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-5a60cccb-50f9-4575-af7d-4e220a29a62a tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:10.837952 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-72ec4979-b0cf-4540-a9d3-2ec0b708e755 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "POST /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5/action" status: 200 len: 14 microversion: 2.1 time: 2.359387 Jan 28 02:07:10.838586 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 95/182] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Jan 28 02:07:08 2022] POST /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5/action => generated 14 bytes in 2361 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 02:07:10.844328 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-56442c7c-2910-43f9-8c84-e392730d71a6 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:07:10.845057 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-56442c7c-2910-43f9-8c84-e392730d71a6 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] [instance: 2f0bfba5-38f6-4375-a6bf-25959ad11fe0] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:10.852631 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-56442c7c-2910-43f9-8c84-e392730d71a6 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:10.853258 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-56442c7c-2910-43f9-8c84-e392730d71a6 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:10.853890 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-56442c7c-2910-43f9-8c84-e392730d71a6 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:10.854382 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-56442c7c-2910-43f9-8c84-e392730d71a6 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:10.890778 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-5a60cccb-50f9-4575-af7d-4e220a29a62a tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "POST /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84/action" status: 200 len: 2680 microversion: 2.20 time: 2.375641 Jan 28 02:07:10.891409 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 88/183] 10.222.0.79 () {62 vars in 1318 bytes} [Fri Jan 28 02:07:08 2022] POST /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84/action => generated 2680 bytes in 2377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 02:07:10.995428 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-56442c7c-2910-43f9-8c84-e392730d71a6 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd7039b8f074a13b2030a2bb7aaff94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc19a0f9c33f47f1b504bebbb0b2c931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:11.002781 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-56442c7c-2910-43f9-8c84-e392730d71a6 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] 10.222.0.79 "GET /compute/v2.1/servers/2f0bfba5-38f6-4375-a6bf-25959ad11fe0" status: 200 len: 1521 microversion: 2.1 time: 0.163082 Jan 28 02:07:11.003333 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 96/184] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:07:10 2022] GET /compute/v2.1/servers/2f0bfba5-38f6-4375-a6bf-25959ad11fe0 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:07:11.849562 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-1ea772d9-35af-4ecc-97cc-54d86723c00b tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:07:11.850477 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-1ea772d9-35af-4ecc-97cc-54d86723c00b tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: d5f49055-da38-486c-9f10-1658c64d46f5] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:11.857262 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-1ea772d9-35af-4ecc-97cc-54d86723c00b tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:11.857710 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-1ea772d9-35af-4ecc-97cc-54d86723c00b tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:11.858467 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-1ea772d9-35af-4ecc-97cc-54d86723c00b tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:11.858897 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-1ea772d9-35af-4ecc-97cc-54d86723c00b tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:11.902826 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-7b5e608b-f0e6-416c-916c-242c5cabad97 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:07:11.903782 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-7b5e608b-f0e6-416c-916c-242c5cabad97 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:11.910005 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-7b5e608b-f0e6-416c-916c-242c5cabad97 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:11.910493 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-7b5e608b-f0e6-416c-916c-242c5cabad97 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:11.911332 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-7b5e608b-f0e6-416c-916c-242c5cabad97 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:11.911764 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-7b5e608b-f0e6-416c-916c-242c5cabad97 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:12.005940 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-1ea772d9-35af-4ecc-97cc-54d86723c00b tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "POST /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5/action" status: 200 len: 14 microversion: 2.1 time: 0.160270 Jan 28 02:07:12.011283 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 89/185] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Jan 28 02:07:11 2022] POST /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5/action => generated 14 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 02:07:12.022107 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-626b1a37-66ea-4f8e-95b8-085a09bf6fea tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:07:12.023167 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-626b1a37-66ea-4f8e-95b8-085a09bf6fea tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] [instance: 2f0bfba5-38f6-4375-a6bf-25959ad11fe0] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:12.032015 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-626b1a37-66ea-4f8e-95b8-085a09bf6fea tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:12.032466 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-626b1a37-66ea-4f8e-95b8-085a09bf6fea tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:12.033302 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-626b1a37-66ea-4f8e-95b8-085a09bf6fea tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:12.033739 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-626b1a37-66ea-4f8e-95b8-085a09bf6fea tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:12.065244 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-7b5e608b-f0e6-416c-916c-242c5cabad97 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "POST /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84/action" status: 200 len: 7357 microversion: 2.20 time: 0.166799 Jan 28 02:07:12.069819 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 97/186] 10.222.0.79 () {62 vars in 1318 bytes} [Fri Jan 28 02:07:11 2022] POST /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84/action => generated 7357 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 02:07:12.168658 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-626b1a37-66ea-4f8e-95b8-085a09bf6fea tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd7039b8f074a13b2030a2bb7aaff94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc19a0f9c33f47f1b504bebbb0b2c931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:12.175931 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-626b1a37-66ea-4f8e-95b8-085a09bf6fea tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] 10.222.0.79 "GET /compute/v2.1/servers/2f0bfba5-38f6-4375-a6bf-25959ad11fe0" status: 200 len: 1521 microversion: 2.1 time: 0.159924 Jan 28 02:07:12.176524 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 90/187] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:07:12 2022] GET /compute/v2.1/servers/2f0bfba5-38f6-4375-a6bf-25959ad11fe0 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:07:13.020208 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-0834664f-a28a-4405-89ab-05f133050d4f tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:07:13.020208 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-0834664f-a28a-4405-89ab-05f133050d4f tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: d5f49055-da38-486c-9f10-1658c64d46f5] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:13.025830 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-0834664f-a28a-4405-89ab-05f133050d4f tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:13.026405 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-0834664f-a28a-4405-89ab-05f133050d4f tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:13.027477 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-0834664f-a28a-4405-89ab-05f133050d4f tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:13.027948 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-0834664f-a28a-4405-89ab-05f133050d4f tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:13.081634 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-68654494-2e81-495e-9a88-69a8a14e1611 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:07:13.083058 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-68654494-2e81-495e-9a88-69a8a14e1611 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:13.094328 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-68654494-2e81-495e-9a88-69a8a14e1611 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:13.094328 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-68654494-2e81-495e-9a88-69a8a14e1611 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:13.094328 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-68654494-2e81-495e-9a88-69a8a14e1611 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:13.094328 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-68654494-2e81-495e-9a88-69a8a14e1611 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:13.145291 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-0834664f-a28a-4405-89ab-05f133050d4f tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "POST /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5/action" status: 200 len: 14 microversion: 2.1 time: 0.131596 Jan 28 02:07:13.158895 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 98/188] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Jan 28 02:07:13 2022] POST /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5/action => generated 14 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 28 02:07:13.199526 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-f08f74b1-4201-4552-8438-4d4e4b6335dc tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:07:13.200355 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-f08f74b1-4201-4552-8438-4d4e4b6335dc tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] [instance: 2f0bfba5-38f6-4375-a6bf-25959ad11fe0] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:13.209272 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-f08f74b1-4201-4552-8438-4d4e4b6335dc tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:13.209272 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-f08f74b1-4201-4552-8438-4d4e4b6335dc tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:13.209272 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-f08f74b1-4201-4552-8438-4d4e4b6335dc tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:13.209272 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-f08f74b1-4201-4552-8438-4d4e4b6335dc tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:13.234427 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-68654494-2e81-495e-9a88-69a8a14e1611 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "POST /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84/action" status: 200 len: 12613 microversion: 2.20 time: 0.158078 Jan 28 02:07:13.235433 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 91/189] 10.222.0.79 () {62 vars in 1318 bytes} [Fri Jan 28 02:07:13 2022] POST /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84/action => generated 12613 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 28 02:07:13.355610 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-f08f74b1-4201-4552-8438-4d4e4b6335dc tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd7039b8f074a13b2030a2bb7aaff94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc19a0f9c33f47f1b504bebbb0b2c931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:13.364225 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-f08f74b1-4201-4552-8438-4d4e4b6335dc tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] 10.222.0.79 "GET /compute/v2.1/servers/2f0bfba5-38f6-4375-a6bf-25959ad11fe0" status: 200 len: 1521 microversion: 2.1 time: 0.173764 Jan 28 02:07:13.365059 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 99/190] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:07:13 2022] GET /compute/v2.1/servers/2f0bfba5-38f6-4375-a6bf-25959ad11fe0 => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:07:14.160916 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-05110131-1cb2-4e0f-9cd1-71972da552ed tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:07:14.161913 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-05110131-1cb2-4e0f-9cd1-71972da552ed tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: d5f49055-da38-486c-9f10-1658c64d46f5] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:14.170458 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-05110131-1cb2-4e0f-9cd1-71972da552ed tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:14.170902 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-05110131-1cb2-4e0f-9cd1-71972da552ed tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:14.172463 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-05110131-1cb2-4e0f-9cd1-71972da552ed tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:14.185570 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-05110131-1cb2-4e0f-9cd1-71972da552ed tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:14.245851 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-b28466e1-7ee4-4502-95c3-2d0ad80847a8 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:07:14.246828 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-b28466e1-7ee4-4502-95c3-2d0ad80847a8 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:14.253249 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-b28466e1-7ee4-4502-95c3-2d0ad80847a8 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:14.253673 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-b28466e1-7ee4-4502-95c3-2d0ad80847a8 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:14.254437 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-b28466e1-7ee4-4502-95c3-2d0ad80847a8 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:14.254865 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-b28466e1-7ee4-4502-95c3-2d0ad80847a8 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:14.302025 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-05110131-1cb2-4e0f-9cd1-71972da552ed tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "POST /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5/action" status: 200 len: 14 microversion: 2.1 time: 0.145753 Jan 28 02:07:14.302654 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 92/191] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Jan 28 02:07:14 2022] POST /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5/action => generated 14 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 02:07:14.308429 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-ba9999ae-76c5-4916-9fc8-87a1ea77f7f3 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:07:14.309003 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-ba9999ae-76c5-4916-9fc8-87a1ea77f7f3 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] [instance: c564cd2f-07df-4c91-9190-30cb5e9cb3ea] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:14.315363 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ba9999ae-76c5-4916-9fc8-87a1ea77f7f3 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:14.315802 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ba9999ae-76c5-4916-9fc8-87a1ea77f7f3 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:14.316584 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ba9999ae-76c5-4916-9fc8-87a1ea77f7f3 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:14.317013 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ba9999ae-76c5-4916-9fc8-87a1ea77f7f3 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:14.342423 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-ba9999ae-76c5-4916-9fc8-87a1ea77f7f3 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] [instance: c564cd2f-07df-4c91-9190-30cb5e9cb3ea] Going to try to terminate instance {{(pid=116375) delete /opt/stack/nova/nova/compute/api.py:2612}} Jan 28 02:07:14.390657 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-b28466e1-7ee4-4502-95c3-2d0ad80847a8 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "POST /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84/action" status: 200 len: 15412 microversion: 2.20 time: 0.148759 Jan 28 02:07:14.391312 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 100/192] 10.222.0.79 () {62 vars in 1318 bytes} [Fri Jan 28 02:07:14 2022] POST /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84/action => generated 15412 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 28 02:07:14.396232 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-072f12e1-0217-49be-b06a-bdc9bbcc6e69 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:07:14.396919 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-072f12e1-0217-49be-b06a-bdc9bbcc6e69 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] [instance: 2f0bfba5-38f6-4375-a6bf-25959ad11fe0] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:14.403699 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-072f12e1-0217-49be-b06a-bdc9bbcc6e69 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:14.404184 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-072f12e1-0217-49be-b06a-bdc9bbcc6e69 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:14.404967 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-072f12e1-0217-49be-b06a-bdc9bbcc6e69 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:14.405399 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-072f12e1-0217-49be-b06a-bdc9bbcc6e69 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:14.548445 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-072f12e1-0217-49be-b06a-bdc9bbcc6e69 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd7039b8f074a13b2030a2bb7aaff94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc19a0f9c33f47f1b504bebbb0b2c931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:14.559126 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-072f12e1-0217-49be-b06a-bdc9bbcc6e69 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] 10.222.0.79 "GET /compute/v2.1/servers/2f0bfba5-38f6-4375-a6bf-25959ad11fe0" status: 200 len: 1521 microversion: 2.1 time: 0.166557 Jan 28 02:07:14.560047 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 101/193] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:07:14 2022] GET /compute/v2.1/servers/2f0bfba5-38f6-4375-a6bf-25959ad11fe0 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:07:14.643873 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-ba9999ae-76c5-4916-9fc8-87a1ea77f7f3 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] 10.222.0.79 "DELETE /compute/v2.1/servers/c564cd2f-07df-4c91-9190-30cb5e9cb3ea" status: 204 len: 0 microversion: 2.1 time: 0.339838 Jan 28 02:07:14.644557 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 93/194] 10.222.0.79 () {58 vars in 1238 bytes} [Fri Jan 28 02:07:14 2022] DELETE /compute/v2.1/servers/c564cd2f-07df-4c91-9190-30cb5e9cb3ea => generated 0 bytes in 341 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 28 02:07:14.653188 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-77f76def-f9cb-48ed-96e8-2737b26462c6 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:07:14.656122 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-77f76def-f9cb-48ed-96e8-2737b26462c6 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] [instance: c564cd2f-07df-4c91-9190-30cb5e9cb3ea] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:14.659612 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-77f76def-f9cb-48ed-96e8-2737b26462c6 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:14.660074 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-77f76def-f9cb-48ed-96e8-2737b26462c6 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:14.660845 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-77f76def-f9cb-48ed-96e8-2737b26462c6 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:14.661308 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-77f76def-f9cb-48ed-96e8-2737b26462c6 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:14.788751 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-77f76def-f9cb-48ed-96e8-2737b26462c6 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891908e1e9c8409ba9e91e341d08825e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22dd75c99404b48a867a48eb5d10c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:14.798026 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-77f76def-f9cb-48ed-96e8-2737b26462c6 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] 10.222.0.79 "GET /compute/v2.1/servers/c564cd2f-07df-4c91-9190-30cb5e9cb3ea" status: 200 len: 1554 microversion: 2.1 time: 0.149198 Jan 28 02:07:14.798719 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 102/195] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:07:14 2022] GET /compute/v2.1/servers/c564cd2f-07df-4c91-9190-30cb5e9cb3ea => generated 1554 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:07:15.314595 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-5a7b59d8-74fd-4fbb-a547-3166e8a45601 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:07:15.316318 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-5a7b59d8-74fd-4fbb-a547-3166e8a45601 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: d5f49055-da38-486c-9f10-1658c64d46f5] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:15.323494 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-5a7b59d8-74fd-4fbb-a547-3166e8a45601 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:15.327545 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-5a7b59d8-74fd-4fbb-a547-3166e8a45601 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:15.327545 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-5a7b59d8-74fd-4fbb-a547-3166e8a45601 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:15.327545 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-5a7b59d8-74fd-4fbb-a547-3166e8a45601 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:15.402646 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-2502da2f-9825-4290-ae98-a5878a086bac tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:07:15.403559 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-2502da2f-9825-4290-ae98-a5878a086bac tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:15.410103 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-2502da2f-9825-4290-ae98-a5878a086bac tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:15.410550 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-2502da2f-9825-4290-ae98-a5878a086bac tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:15.411351 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-2502da2f-9825-4290-ae98-a5878a086bac tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:15.411886 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-2502da2f-9825-4290-ae98-a5878a086bac tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:15.444538 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-5a7b59d8-74fd-4fbb-a547-3166e8a45601 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "POST /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5/action" status: 200 len: 14 microversion: 2.1 time: 0.134358 Jan 28 02:07:15.445172 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 94/196] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Jan 28 02:07:15 2022] POST /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5/action => generated 14 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 02:07:15.539376 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-2502da2f-9825-4290-ae98-a5878a086bac tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "POST /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84/action" status: 200 len: 17861 microversion: 2.20 time: 0.140836 Jan 28 02:07:15.539965 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 103/197] 10.222.0.79 () {62 vars in 1318 bytes} [Fri Jan 28 02:07:15 2022] POST /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84/action => generated 17861 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 28 02:07:15.577295 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-9eb7b0c4-cbc0-4451-88b5-5ad9be32a974 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:07:15.577988 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-9eb7b0c4-cbc0-4451-88b5-5ad9be32a974 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] [instance: 2f0bfba5-38f6-4375-a6bf-25959ad11fe0] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:15.584331 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-9eb7b0c4-cbc0-4451-88b5-5ad9be32a974 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:15.584823 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-9eb7b0c4-cbc0-4451-88b5-5ad9be32a974 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:15.585584 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-9eb7b0c4-cbc0-4451-88b5-5ad9be32a974 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:15.586012 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-9eb7b0c4-cbc0-4451-88b5-5ad9be32a974 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:15.714823 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-9eb7b0c4-cbc0-4451-88b5-5ad9be32a974 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd7039b8f074a13b2030a2bb7aaff94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc19a0f9c33f47f1b504bebbb0b2c931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:15.722805 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-9eb7b0c4-cbc0-4451-88b5-5ad9be32a974 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] 10.222.0.79 "GET /compute/v2.1/servers/2f0bfba5-38f6-4375-a6bf-25959ad11fe0" status: 200 len: 1521 microversion: 2.1 time: 0.149649 Jan 28 02:07:15.725340 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 95/198] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:07:15 2022] GET /compute/v2.1/servers/2f0bfba5-38f6-4375-a6bf-25959ad11fe0 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:07:15.816791 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-5aa25b03-0c33-4fbd-93ab-5eb62f0df4f5 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:07:15.817490 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-5aa25b03-0c33-4fbd-93ab-5eb62f0df4f5 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] [instance: c564cd2f-07df-4c91-9190-30cb5e9cb3ea] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:15.824809 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-5aa25b03-0c33-4fbd-93ab-5eb62f0df4f5 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:15.831105 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-5aa25b03-0c33-4fbd-93ab-5eb62f0df4f5 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:15.831105 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-5aa25b03-0c33-4fbd-93ab-5eb62f0df4f5 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:15.831105 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-5aa25b03-0c33-4fbd-93ab-5eb62f0df4f5 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:15.959083 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-5aa25b03-0c33-4fbd-93ab-5eb62f0df4f5 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891908e1e9c8409ba9e91e341d08825e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22dd75c99404b48a867a48eb5d10c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:15.967989 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-5aa25b03-0c33-4fbd-93ab-5eb62f0df4f5 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] 10.222.0.79 "GET /compute/v2.1/servers/c564cd2f-07df-4c91-9190-30cb5e9cb3ea" status: 200 len: 1554 microversion: 2.1 time: 0.155509 Jan 28 02:07:15.968549 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 104/199] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:07:15 2022] GET /compute/v2.1/servers/c564cd2f-07df-4c91-9190-30cb5e9cb3ea => generated 1554 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:07:16.462932 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-48b303c9-b650-4a93-87dc-a4f76889cedb tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:07:16.464397 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-48b303c9-b650-4a93-87dc-a4f76889cedb tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: d5f49055-da38-486c-9f10-1658c64d46f5] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:16.472161 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-48b303c9-b650-4a93-87dc-a4f76889cedb tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:16.477072 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-48b303c9-b650-4a93-87dc-a4f76889cedb tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:16.477072 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-48b303c9-b650-4a93-87dc-a4f76889cedb tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:16.477072 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-48b303c9-b650-4a93-87dc-a4f76889cedb tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:16.550685 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-e179ee3d-b947-4ec4-8f60-51e4a5b3d565 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:07:16.552247 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-e179ee3d-b947-4ec4-8f60-51e4a5b3d565 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:16.559514 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-e179ee3d-b947-4ec4-8f60-51e4a5b3d565 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:16.560241 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-e179ee3d-b947-4ec4-8f60-51e4a5b3d565 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:16.561205 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-e179ee3d-b947-4ec4-8f60-51e4a5b3d565 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:16.561823 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-e179ee3d-b947-4ec4-8f60-51e4a5b3d565 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:16.716455 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-48b303c9-b650-4a93-87dc-a4f76889cedb tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "POST /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5/action" status: 200 len: 14 microversion: 2.1 time: 0.259144 Jan 28 02:07:16.719806 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 96/200] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Jan 28 02:07:16 2022] POST /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5/action => generated 14 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 02:07:16.740925 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-b28d37b9-f975-436d-a9ff-7be0e338369d tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:07:16.741606 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-b28d37b9-f975-436d-a9ff-7be0e338369d tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] [instance: 2f0bfba5-38f6-4375-a6bf-25959ad11fe0] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:16.749446 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b28d37b9-f975-436d-a9ff-7be0e338369d tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:16.749881 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b28d37b9-f975-436d-a9ff-7be0e338369d tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:16.750636 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b28d37b9-f975-436d-a9ff-7be0e338369d tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:16.751061 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b28d37b9-f975-436d-a9ff-7be0e338369d tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:16.760513 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-e179ee3d-b947-4ec4-8f60-51e4a5b3d565 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "POST /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84/action" status: 200 len: 19342 microversion: 2.20 time: 0.212699 Jan 28 02:07:16.761331 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 105/201] 10.222.0.79 () {62 vars in 1318 bytes} [Fri Jan 28 02:07:16 2022] POST /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84/action => generated 19342 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:07:16.881352 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-b28d37b9-f975-436d-a9ff-7be0e338369d tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd7039b8f074a13b2030a2bb7aaff94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc19a0f9c33f47f1b504bebbb0b2c931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:16.890177 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-b28d37b9-f975-436d-a9ff-7be0e338369d tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] 10.222.0.79 "GET /compute/v2.1/servers/2f0bfba5-38f6-4375-a6bf-25959ad11fe0" status: 200 len: 1521 microversion: 2.1 time: 0.153302 Jan 28 02:07:16.890763 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 97/202] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:07:16 2022] GET /compute/v2.1/servers/2f0bfba5-38f6-4375-a6bf-25959ad11fe0 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:07:16.985794 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-b134d08e-023b-45ac-baba-5a869bd29897 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:07:16.986492 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-b134d08e-023b-45ac-baba-5a869bd29897 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] [instance: c564cd2f-07df-4c91-9190-30cb5e9cb3ea] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:16.992821 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-b134d08e-023b-45ac-baba-5a869bd29897 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:16.993273 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-b134d08e-023b-45ac-baba-5a869bd29897 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:16.994702 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-b134d08e-023b-45ac-baba-5a869bd29897 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:16.995066 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-b134d08e-023b-45ac-baba-5a869bd29897 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:17.127499 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-b134d08e-023b-45ac-baba-5a869bd29897 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891908e1e9c8409ba9e91e341d08825e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22dd75c99404b48a867a48eb5d10c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:17.135129 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-b134d08e-023b-45ac-baba-5a869bd29897 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] 10.222.0.79 "GET /compute/v2.1/servers/c564cd2f-07df-4c91-9190-30cb5e9cb3ea" status: 200 len: 1554 microversion: 2.1 time: 0.153292 Jan 28 02:07:17.135840 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 106/203] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:07:16 2022] GET /compute/v2.1/servers/c564cd2f-07df-4c91-9190-30cb5e9cb3ea => generated 1554 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:07:17.729847 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-559189f8-cd4d-4c1f-9984-519c00726fea tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:07:17.730875 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-559189f8-cd4d-4c1f-9984-519c00726fea tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: d5f49055-da38-486c-9f10-1658c64d46f5] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:17.737205 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-559189f8-cd4d-4c1f-9984-519c00726fea tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:17.737648 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-559189f8-cd4d-4c1f-9984-519c00726fea tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:17.738417 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-559189f8-cd4d-4c1f-9984-519c00726fea tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:17.738840 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-559189f8-cd4d-4c1f-9984-519c00726fea tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:17.776896 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-e9e9b3cc-bcb1-405b-be27-416d6c0868f0 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:07:17.776896 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-e9e9b3cc-bcb1-405b-be27-416d6c0868f0 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:17.796733 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-e9e9b3cc-bcb1-405b-be27-416d6c0868f0 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:17.797682 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-e9e9b3cc-bcb1-405b-be27-416d6c0868f0 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:17.799790 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-e9e9b3cc-bcb1-405b-be27-416d6c0868f0 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:17.800413 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-e9e9b3cc-bcb1-405b-be27-416d6c0868f0 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:17.902764 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-559189f8-cd4d-4c1f-9984-519c00726fea tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "POST /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5/action" status: 200 len: 6100 microversion: 2.1 time: 0.177022 Jan 28 02:07:17.902764 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 98/204] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Jan 28 02:07:17 2022] POST /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5/action => generated 6100 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:07:17.914715 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-e3b36a08-f96b-4ef6-974e-3bfb54b94d47 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:07:17.920792 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-e3b36a08-f96b-4ef6-974e-3bfb54b94d47 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] [instance: 2f0bfba5-38f6-4375-a6bf-25959ad11fe0] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:17.935347 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-e3b36a08-f96b-4ef6-974e-3bfb54b94d47 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:17.936554 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-e3b36a08-f96b-4ef6-974e-3bfb54b94d47 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:17.937180 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-e3b36a08-f96b-4ef6-974e-3bfb54b94d47 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:17.937591 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-e3b36a08-f96b-4ef6-974e-3bfb54b94d47 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:17.951510 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-e9e9b3cc-bcb1-405b-be27-416d6c0868f0 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "POST /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84/action" status: 200 len: 20511 microversion: 2.20 time: 0.181691 Jan 28 02:07:17.952859 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 107/205] 10.222.0.79 () {62 vars in 1318 bytes} [Fri Jan 28 02:07:17 2022] POST /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84/action => generated 20511 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:07:18.154721 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-b8be6202-56c6-4bd8-8794-bb3c0d608026 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:07:18.155547 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-b8be6202-56c6-4bd8-8794-bb3c0d608026 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] [instance: c564cd2f-07df-4c91-9190-30cb5e9cb3ea] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:18.164548 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-b8be6202-56c6-4bd8-8794-bb3c0d608026 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:18.164548 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-b8be6202-56c6-4bd8-8794-bb3c0d608026 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:18.164548 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-b8be6202-56c6-4bd8-8794-bb3c0d608026 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:18.174405 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-b8be6202-56c6-4bd8-8794-bb3c0d608026 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:18.228529 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-e3b36a08-f96b-4ef6-974e-3bfb54b94d47 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd7039b8f074a13b2030a2bb7aaff94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc19a0f9c33f47f1b504bebbb0b2c931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:18.238075 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-e3b36a08-f96b-4ef6-974e-3bfb54b94d47 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] 10.222.0.79 "GET /compute/v2.1/servers/2f0bfba5-38f6-4375-a6bf-25959ad11fe0" status: 200 len: 1521 microversion: 2.1 time: 0.328905 Jan 28 02:07:18.238704 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 99/206] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:07:17 2022] GET /compute/v2.1/servers/2f0bfba5-38f6-4375-a6bf-25959ad11fe0 => generated 1521 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:07:18.470780 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-b8be6202-56c6-4bd8-8794-bb3c0d608026 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891908e1e9c8409ba9e91e341d08825e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22dd75c99404b48a867a48eb5d10c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:18.481068 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-b8be6202-56c6-4bd8-8794-bb3c0d608026 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] 10.222.0.79 "GET /compute/v2.1/servers/c564cd2f-07df-4c91-9190-30cb5e9cb3ea" status: 200 len: 1554 microversion: 2.1 time: 0.331997 Jan 28 02:07:18.491069 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 108/207] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:07:18 2022] GET /compute/v2.1/servers/c564cd2f-07df-4c91-9190-30cb5e9cb3ea => generated 1554 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:07:18.912382 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-4ab8d9ec-646b-4a3e-9416-e1db979e34b0 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:07:18.913385 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-4ab8d9ec-646b-4a3e-9416-e1db979e34b0 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: d5f49055-da38-486c-9f10-1658c64d46f5] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:18.919855 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-4ab8d9ec-646b-4a3e-9416-e1db979e34b0 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:18.920266 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-4ab8d9ec-646b-4a3e-9416-e1db979e34b0 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:18.921132 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-4ab8d9ec-646b-4a3e-9416-e1db979e34b0 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:18.921683 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-4ab8d9ec-646b-4a3e-9416-e1db979e34b0 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:18.945984 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [req-d9f88bdc-e955-4d22-9635-1e75bef96894 req-9a03e8e0-4885-4a23-b3a1-03d348d6a298 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c564cd2f-07df-4c91-9190-30cb5e9cb3ea", "name": "network-vif-deleted", "tag": "f7f220d5-8156-4a22-9350-5b5670680867"}]} {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:07:18.948796 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:07:18.948796 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: warnings.warn(msg) Jan 28 02:07:18.957923 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [req-d9f88bdc-e955-4d22-9635-1e75bef96894 req-9a03e8e0-4885-4a23-b3a1-03d348d6a298 service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:18.958648 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [req-d9f88bdc-e955-4d22-9635-1e75bef96894 req-9a03e8e0-4885-4a23-b3a1-03d348d6a298 service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:18.971331 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.compute.server_external_events [req-d9f88bdc-e955-4d22-9635-1e75bef96894 req-9a03e8e0-4885-4a23-b3a1-03d348d6a298 service nova] Creating event network-vif-deleted:f7f220d5-8156-4a22-9350-5b5670680867 for instance c564cd2f-07df-4c91-9190-30cb5e9cb3ea on hv-cinder-82497 Jan 28 02:07:18.976239 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [req-d9f88bdc-e955-4d22-9635-1e75bef96894 req-9a03e8e0-4885-4a23-b3a1-03d348d6a298 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035128 Jan 28 02:07:18.976827 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 109/208] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Jan 28 02:07:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:07:18.985293 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-bd826664-402f-460e-a609-f1c89886014e tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:07:18.986286 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-bd826664-402f-460e-a609-f1c89886014e tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:18.992406 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-bd826664-402f-460e-a609-f1c89886014e tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:18.992862 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-bd826664-402f-460e-a609-f1c89886014e tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:18.997736 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-bd826664-402f-460e-a609-f1c89886014e tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:18.998201 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-bd826664-402f-460e-a609-f1c89886014e tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:19.097339 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-4ab8d9ec-646b-4a3e-9416-e1db979e34b0 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "POST /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5/action" status: 200 len: 10009 microversion: 2.1 time: 0.187846 Jan 28 02:07:19.098876 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 100/209] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Jan 28 02:07:18 2022] POST /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5/action => generated 10009 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 02:07:19.257394 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-796ef454-690b-41a4-b418-511b2a0c0c82 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:07:19.258105 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-796ef454-690b-41a4-b418-511b2a0c0c82 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] [instance: 2f0bfba5-38f6-4375-a6bf-25959ad11fe0] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:19.264876 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-796ef454-690b-41a4-b418-511b2a0c0c82 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:19.265314 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-796ef454-690b-41a4-b418-511b2a0c0c82 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:19.266972 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-796ef454-690b-41a4-b418-511b2a0c0c82 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:19.267400 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-796ef454-690b-41a4-b418-511b2a0c0c82 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:19.406844 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-796ef454-690b-41a4-b418-511b2a0c0c82 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd7039b8f074a13b2030a2bb7aaff94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc19a0f9c33f47f1b504bebbb0b2c931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:19.415290 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-796ef454-690b-41a4-b418-511b2a0c0c82 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] 10.222.0.79 "GET /compute/v2.1/servers/2f0bfba5-38f6-4375-a6bf-25959ad11fe0" status: 200 len: 1521 microversion: 2.1 time: 0.162523 Jan 28 02:07:19.417016 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 101/210] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:07:19 2022] GET /compute/v2.1/servers/2f0bfba5-38f6-4375-a6bf-25959ad11fe0 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:07:19.503237 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-0e6604a0-9c4b-4537-b433-7e1ba7e2da75 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:07:19.503845 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-0e6604a0-9c4b-4537-b433-7e1ba7e2da75 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] [instance: c564cd2f-07df-4c91-9190-30cb5e9cb3ea] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:19.521961 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-0e6604a0-9c4b-4537-b433-7e1ba7e2da75 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:19.522412 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-0e6604a0-9c4b-4537-b433-7e1ba7e2da75 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:19.524362 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-0e6604a0-9c4b-4537-b433-7e1ba7e2da75 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:19.525795 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-0e6604a0-9c4b-4537-b433-7e1ba7e2da75 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:19.588573 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-0e6604a0-9c4b-4537-b433-7e1ba7e2da75 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891908e1e9c8409ba9e91e341d08825e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22dd75c99404b48a867a48eb5d10c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:19.596870 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-0e6604a0-9c4b-4537-b433-7e1ba7e2da75 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] 10.222.0.79 "GET /compute/v2.1/servers/c564cd2f-07df-4c91-9190-30cb5e9cb3ea" status: 200 len: 1345 microversion: 2.1 time: 0.103443 Jan 28 02:07:19.597637 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 102/211] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:07:19 2022] GET /compute/v2.1/servers/c564cd2f-07df-4c91-9190-30cb5e9cb3ea => generated 1345 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:07:20.109963 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-3db088d6-6229-4078-a554-3487003ff575 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:07:20.111155 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-3db088d6-6229-4078-a554-3487003ff575 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: d5f49055-da38-486c-9f10-1658c64d46f5] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:20.117391 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-3db088d6-6229-4078-a554-3487003ff575 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:20.117944 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-3db088d6-6229-4078-a554-3487003ff575 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:20.118822 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-3db088d6-6229-4078-a554-3487003ff575 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:20.119555 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-3db088d6-6229-4078-a554-3487003ff575 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:22.199149 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-bd826664-402f-460e-a609-f1c89886014e tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "POST /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84/action" status: 200 len: 22024 microversion: 2.20 time: 3.217695 Jan 28 02:07:22.204246 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 110/212] 10.222.0.79 () {62 vars in 1318 bytes} [Fri Jan 28 02:07:18 2022] POST /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84/action => generated 22024 bytes in 3223 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:07:22.206699 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-84500dc5-b463-426c-abae-c63941f157b3 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:07:22.207428 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-84500dc5-b463-426c-abae-c63941f157b3 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] [instance: 2f0bfba5-38f6-4375-a6bf-25959ad11fe0] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:22.215648 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-84500dc5-b463-426c-abae-c63941f157b3 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:22.216882 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-84500dc5-b463-426c-abae-c63941f157b3 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:22.217713 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-84500dc5-b463-426c-abae-c63941f157b3 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:22.218145 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-84500dc5-b463-426c-abae-c63941f157b3 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:22.319171 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-3db088d6-6229-4078-a554-3487003ff575 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "POST /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5/action" status: 200 len: 17000 microversion: 2.1 time: 2.212525 Jan 28 02:07:22.320430 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 103/213] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Jan 28 02:07:20 2022] POST /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5/action => generated 17000 bytes in 2215 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 02:07:22.326629 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-553ee393-e90e-45ca-b61b-cb869565fc1a tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:07:22.327411 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-553ee393-e90e-45ca-b61b-cb869565fc1a tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] [instance: c564cd2f-07df-4c91-9190-30cb5e9cb3ea] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:22.333747 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-553ee393-e90e-45ca-b61b-cb869565fc1a tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:22.334209 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-553ee393-e90e-45ca-b61b-cb869565fc1a tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:22.335043 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-553ee393-e90e-45ca-b61b-cb869565fc1a tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:22.335564 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-553ee393-e90e-45ca-b61b-cb869565fc1a tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:22.358738 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-84500dc5-b463-426c-abae-c63941f157b3 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd7039b8f074a13b2030a2bb7aaff94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc19a0f9c33f47f1b504bebbb0b2c931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:22.366410 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-84500dc5-b463-426c-abae-c63941f157b3 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] 10.222.0.79 "GET /compute/v2.1/servers/2f0bfba5-38f6-4375-a6bf-25959ad11fe0" status: 200 len: 1521 microversion: 2.1 time: 0.164234 Jan 28 02:07:22.366979 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 111/214] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:07:22 2022] GET /compute/v2.1/servers/2f0bfba5-38f6-4375-a6bf-25959ad11fe0 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:07:22.402647 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-553ee393-e90e-45ca-b61b-cb869565fc1a tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891908e1e9c8409ba9e91e341d08825e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22dd75c99404b48a867a48eb5d10c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:22.411583 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-553ee393-e90e-45ca-b61b-cb869565fc1a tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] 10.222.0.79 "GET /compute/v2.1/servers/c564cd2f-07df-4c91-9190-30cb5e9cb3ea" status: 200 len: 1345 microversion: 2.1 time: 0.089772 Jan 28 02:07:22.412300 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 104/215] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:07:22 2022] GET /compute/v2.1/servers/c564cd2f-07df-4c91-9190-30cb5e9cb3ea => generated 1345 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:07:23.212032 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-6ebd08a8-573e-4a7b-82b7-6d38ffdff306 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:07:23.213049 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-6ebd08a8-573e-4a7b-82b7-6d38ffdff306 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:23.221291 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-6ebd08a8-573e-4a7b-82b7-6d38ffdff306 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:23.221829 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-6ebd08a8-573e-4a7b-82b7-6d38ffdff306 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:23.222788 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-6ebd08a8-573e-4a7b-82b7-6d38ffdff306 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:23.223379 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-6ebd08a8-573e-4a7b-82b7-6d38ffdff306 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:23.337522 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-b6c71d36-c197-4f37-bee6-884b64e48d59 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:07:23.340387 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-b6c71d36-c197-4f37-bee6-884b64e48d59 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: d5f49055-da38-486c-9f10-1658c64d46f5] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:23.348327 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b6c71d36-c197-4f37-bee6-884b64e48d59 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:23.349293 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b6c71d36-c197-4f37-bee6-884b64e48d59 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:23.351027 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b6c71d36-c197-4f37-bee6-884b64e48d59 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:23.351586 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b6c71d36-c197-4f37-bee6-884b64e48d59 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:26.155151 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-6ebd08a8-573e-4a7b-82b7-6d38ffdff306 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "POST /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84/action" status: 200 len: 26712 microversion: 2.20 time: 2.946745 Jan 28 02:07:26.155800 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 112/216] 10.222.0.79 () {62 vars in 1318 bytes} [Fri Jan 28 02:07:23 2022] POST /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84/action => generated 26712 bytes in 2948 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:07:26.160832 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-84aac6c9-7430-457a-9412-088de9900b52 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:07:26.161549 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-84aac6c9-7430-457a-9412-088de9900b52 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] [instance: 2f0bfba5-38f6-4375-a6bf-25959ad11fe0] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:26.169057 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-84aac6c9-7430-457a-9412-088de9900b52 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:26.169508 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-84aac6c9-7430-457a-9412-088de9900b52 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:26.170275 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-84aac6c9-7430-457a-9412-088de9900b52 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:26.170842 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-84aac6c9-7430-457a-9412-088de9900b52 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:26.182030 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-b6c71d36-c197-4f37-bee6-884b64e48d59 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "POST /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5/action" status: 200 len: 20511 microversion: 2.1 time: 2.853040 Jan 28 02:07:26.182812 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 105/217] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Jan 28 02:07:23 2022] POST /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5/action => generated 20511 bytes in 2855 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 02:07:26.187704 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-6a0123b5-3900-49ec-93f2-71ef6d1f952c tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:07:26.194890 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-6a0123b5-3900-49ec-93f2-71ef6d1f952c tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] [instance: c564cd2f-07df-4c91-9190-30cb5e9cb3ea] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:26.194890 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-6a0123b5-3900-49ec-93f2-71ef6d1f952c tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:26.195440 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-6a0123b5-3900-49ec-93f2-71ef6d1f952c tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:26.196297 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-6a0123b5-3900-49ec-93f2-71ef6d1f952c tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:26.196727 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-6a0123b5-3900-49ec-93f2-71ef6d1f952c tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:26.265409 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-6a0123b5-3900-49ec-93f2-71ef6d1f952c tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891908e1e9c8409ba9e91e341d08825e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22dd75c99404b48a867a48eb5d10c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:26.272800 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-6a0123b5-3900-49ec-93f2-71ef6d1f952c tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] 10.222.0.79 "GET /compute/v2.1/servers/c564cd2f-07df-4c91-9190-30cb5e9cb3ea" status: 200 len: 1345 microversion: 2.1 time: 0.088792 Jan 28 02:07:26.273569 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 106/218] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:07:26 2022] GET /compute/v2.1/servers/c564cd2f-07df-4c91-9190-30cb5e9cb3ea => generated 1345 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:07:26.321051 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-84aac6c9-7430-457a-9412-088de9900b52 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd7039b8f074a13b2030a2bb7aaff94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc19a0f9c33f47f1b504bebbb0b2c931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:26.328568 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-84aac6c9-7430-457a-9412-088de9900b52 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] 10.222.0.79 "GET /compute/v2.1/servers/2f0bfba5-38f6-4375-a6bf-25959ad11fe0" status: 200 len: 1521 microversion: 2.1 time: 0.171475 Jan 28 02:07:26.330007 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 113/219] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:07:26 2022] GET /compute/v2.1/servers/2f0bfba5-38f6-4375-a6bf-25959ad11fe0 => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:07:27.167045 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-591c0fd4-6a33-499a-8351-8f4cf15be5b8 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:07:27.167952 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-591c0fd4-6a33-499a-8351-8f4cf15be5b8 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:27.173726 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-591c0fd4-6a33-499a-8351-8f4cf15be5b8 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:27.174167 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-591c0fd4-6a33-499a-8351-8f4cf15be5b8 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:27.174933 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-591c0fd4-6a33-499a-8351-8f4cf15be5b8 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:27.175368 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-591c0fd4-6a33-499a-8351-8f4cf15be5b8 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:27.194441 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-68a68ebf-d714-41f6-8604-b6f91409360a tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:07:27.195365 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-68a68ebf-d714-41f6-8604-b6f91409360a tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: d5f49055-da38-486c-9f10-1658c64d46f5] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:27.202022 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-68a68ebf-d714-41f6-8604-b6f91409360a tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:27.202493 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-68a68ebf-d714-41f6-8604-b6f91409360a tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:27.203246 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-68a68ebf-d714-41f6-8604-b6f91409360a tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:27.203678 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-68a68ebf-d714-41f6-8604-b6f91409360a tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:27.317595 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-591c0fd4-6a33-499a-8351-8f4cf15be5b8 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "POST /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84/action" status: 200 len: 27207 microversion: 2.20 time: 0.154483 Jan 28 02:07:27.318266 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 107/220] 10.222.0.79 () {62 vars in 1318 bytes} [Fri Jan 28 02:07:27 2022] POST /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84/action => generated 27207 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:07:27.324823 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-f76d777a-ce74-403a-9ba3-1777c00ca03b tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:07:27.325937 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-f76d777a-ce74-403a-9ba3-1777c00ca03b tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] [instance: c564cd2f-07df-4c91-9190-30cb5e9cb3ea] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:27.334311 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f76d777a-ce74-403a-9ba3-1777c00ca03b tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:27.334758 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f76d777a-ce74-403a-9ba3-1777c00ca03b tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:27.335713 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f76d777a-ce74-403a-9ba3-1777c00ca03b tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:27.336344 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f76d777a-ce74-403a-9ba3-1777c00ca03b tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:27.365894 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-68a68ebf-d714-41f6-8604-b6f91409360a tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "POST /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5/action" status: 200 len: 21958 microversion: 2.1 time: 0.174908 Jan 28 02:07:27.371044 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 114/221] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Jan 28 02:07:27 2022] POST /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5/action => generated 21958 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 02:07:27.378007 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f76d777a-ce74-403a-9ba3-1777c00ca03b tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:27.381940 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-5ea1daf8-e367-4fda-a18e-6ecbeeab2a90 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:07:27.381940 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-5ea1daf8-e367-4fda-a18e-6ecbeeab2a90 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] [instance: 2f0bfba5-38f6-4375-a6bf-25959ad11fe0] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:27.382933 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f76d777a-ce74-403a-9ba3-1777c00ca03b tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:27.383629 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.objects.instance [None req-f76d777a-ce74-403a-9ba3-1777c00ca03b tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lazy-loading 'fault' on Instance uuid c564cd2f-07df-4c91-9190-30cb5e9cb3ea {{(pid=116375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jan 28 02:07:27.389602 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-5ea1daf8-e367-4fda-a18e-6ecbeeab2a90 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:27.390194 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-5ea1daf8-e367-4fda-a18e-6ecbeeab2a90 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:27.390992 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-5ea1daf8-e367-4fda-a18e-6ecbeeab2a90 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:27.391607 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-5ea1daf8-e367-4fda-a18e-6ecbeeab2a90 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:27.452660 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-f76d777a-ce74-403a-9ba3-1777c00ca03b tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891908e1e9c8409ba9e91e341d08825e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22dd75c99404b48a867a48eb5d10c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:27.480482 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-f76d777a-ce74-403a-9ba3-1777c00ca03b tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] 10.222.0.79 "GET /compute/v2.1/servers/c564cd2f-07df-4c91-9190-30cb5e9cb3ea" status: 200 len: 1350 microversion: 2.1 time: 0.160817 Jan 28 02:07:27.481964 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 108/222] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:07:27 2022] GET /compute/v2.1/servers/c564cd2f-07df-4c91-9190-30cb5e9cb3ea => generated 1350 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:07:27.561502 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-5ea1daf8-e367-4fda-a18e-6ecbeeab2a90 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd7039b8f074a13b2030a2bb7aaff94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc19a0f9c33f47f1b504bebbb0b2c931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:27.568990 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-5ea1daf8-e367-4fda-a18e-6ecbeeab2a90 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] 10.222.0.79 "GET /compute/v2.1/servers/2f0bfba5-38f6-4375-a6bf-25959ad11fe0" status: 200 len: 1521 microversion: 2.1 time: 0.196290 Jan 28 02:07:27.569398 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 115/223] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:07:27 2022] GET /compute/v2.1/servers/2f0bfba5-38f6-4375-a6bf-25959ad11fe0 => generated 1521 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:07:28.330487 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-d2a7de21-8499-4778-8178-556b485a6c14 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:07:28.331389 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-d2a7de21-8499-4778-8178-556b485a6c14 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:28.338253 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-d2a7de21-8499-4778-8178-556b485a6c14 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:28.338657 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-d2a7de21-8499-4778-8178-556b485a6c14 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:28.339521 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-d2a7de21-8499-4778-8178-556b485a6c14 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:28.339947 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-d2a7de21-8499-4778-8178-556b485a6c14 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:28.378175 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-5c73f01d-23da-4838-801e-f8d777de801f tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:07:28.378995 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-5c73f01d-23da-4838-801e-f8d777de801f tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: d5f49055-da38-486c-9f10-1658c64d46f5] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:28.385766 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-5c73f01d-23da-4838-801e-f8d777de801f tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:28.386090 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-5c73f01d-23da-4838-801e-f8d777de801f tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:28.386860 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-5c73f01d-23da-4838-801e-f8d777de801f tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:28.387298 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-5c73f01d-23da-4838-801e-f8d777de801f tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:28.482572 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-d2a7de21-8499-4778-8178-556b485a6c14 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "POST /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84/action" status: 200 len: 27549 microversion: 2.20 time: 0.155645 Jan 28 02:07:28.483219 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 109/224] 10.222.0.79 () {62 vars in 1318 bytes} [Fri Jan 28 02:07:28 2022] POST /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84/action => generated 27549 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:07:28.499518 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-6ce497ba-43d6-4bcd-825d-749fb2ee5021 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:07:28.500855 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-6ce497ba-43d6-4bcd-825d-749fb2ee5021 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] [instance: c564cd2f-07df-4c91-9190-30cb5e9cb3ea] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:28.507715 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-6ce497ba-43d6-4bcd-825d-749fb2ee5021 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:28.508205 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-6ce497ba-43d6-4bcd-825d-749fb2ee5021 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:28.508965 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-6ce497ba-43d6-4bcd-825d-749fb2ee5021 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:28.509882 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-6ce497ba-43d6-4bcd-825d-749fb2ee5021 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:28.523668 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.wsgi [None req-6ce497ba-43d6-4bcd-825d-749fb2ee5021 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] HTTP exception thrown: Instance c564cd2f-07df-4c91-9190-30cb5e9cb3ea could not be found. Jan 28 02:07:28.524279 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-6ce497ba-43d6-4bcd-825d-749fb2ee5021 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Returning 404 to user: Instance c564cd2f-07df-4c91-9190-30cb5e9cb3ea could not be found. {{(pid=116375) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 02:07:28.525895 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-6ce497ba-43d6-4bcd-825d-749fb2ee5021 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] 10.222.0.79 "GET /compute/v2.1/servers/c564cd2f-07df-4c91-9190-30cb5e9cb3ea" status: 404 len: 111 microversion: 2.1 time: 0.029927 Jan 28 02:07:28.526027 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-5c73f01d-23da-4838-801e-f8d777de801f tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "POST /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5/action" status: 200 len: 23117 microversion: 2.1 time: 0.150417 Jan 28 02:07:28.527016 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 116/225] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Jan 28 02:07:28 2022] POST /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5/action => generated 23117 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 02:07:28.530270 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 110/226] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:07:28 2022] GET /compute/v2.1/servers/c564cd2f-07df-4c91-9190-30cb5e9cb3ea => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 02:07:28.594177 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-c4845e2f-b8b5-4ec4-9946-50de420efaea tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:07:28.594177 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-c4845e2f-b8b5-4ec4-9946-50de420efaea tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] [instance: 2f0bfba5-38f6-4375-a6bf-25959ad11fe0] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:28.599610 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-c4845e2f-b8b5-4ec4-9946-50de420efaea tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:28.600082 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-c4845e2f-b8b5-4ec4-9946-50de420efaea tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:28.600863 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-c4845e2f-b8b5-4ec4-9946-50de420efaea tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:28.601294 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-c4845e2f-b8b5-4ec4-9946-50de420efaea tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:28.643403 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-ae711955-d705-45e7-94e6-171d561b47e9 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:07:28.644740 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-ae711955-d705-45e7-94e6-171d561b47e9 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] [instance: c564cd2f-07df-4c91-9190-30cb5e9cb3ea] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:28.652206 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ae711955-d705-45e7-94e6-171d561b47e9 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:28.652680 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ae711955-d705-45e7-94e6-171d561b47e9 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:28.653432 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ae711955-d705-45e7-94e6-171d561b47e9 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:28.653854 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ae711955-d705-45e7-94e6-171d561b47e9 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:28.680077 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.wsgi [None req-ae711955-d705-45e7-94e6-171d561b47e9 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] HTTP exception thrown: Instance c564cd2f-07df-4c91-9190-30cb5e9cb3ea could not be found. Jan 28 02:07:28.680077 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-ae711955-d705-45e7-94e6-171d561b47e9 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Returning 404 to user: Instance c564cd2f-07df-4c91-9190-30cb5e9cb3ea could not be found. {{(pid=116375) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 02:07:28.680077 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-ae711955-d705-45e7-94e6-171d561b47e9 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] 10.222.0.79 "GET /compute/v2.1/servers/c564cd2f-07df-4c91-9190-30cb5e9cb3ea/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.041291 Jan 28 02:07:28.685942 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 111/227] 10.222.0.79 () {58 vars in 1301 bytes} [Fri Jan 28 02:07:28 2022] GET /compute/v2.1/servers/c564cd2f-07df-4c91-9190-30cb5e9cb3ea/os-volume_attachments => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 02:07:28.779926 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-c4845e2f-b8b5-4ec4-9946-50de420efaea tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd7039b8f074a13b2030a2bb7aaff94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc19a0f9c33f47f1b504bebbb0b2c931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:28.788889 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-c4845e2f-b8b5-4ec4-9946-50de420efaea tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] 10.222.0.79 "GET /compute/v2.1/servers/2f0bfba5-38f6-4375-a6bf-25959ad11fe0" status: 200 len: 1521 microversion: 2.1 time: 0.205770 Jan 28 02:07:28.789466 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 117/228] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:07:28 2022] GET /compute/v2.1/servers/2f0bfba5-38f6-4375-a6bf-25959ad11fe0 => generated 1521 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:07:29.496141 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-598f5d05-1684-4a6e-87a9-4aec9398bca0 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:07:29.497119 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-598f5d05-1684-4a6e-87a9-4aec9398bca0 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:29.503098 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-598f5d05-1684-4a6e-87a9-4aec9398bca0 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:29.503541 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-598f5d05-1684-4a6e-87a9-4aec9398bca0 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:29.504350 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-598f5d05-1684-4a6e-87a9-4aec9398bca0 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:29.504788 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-598f5d05-1684-4a6e-87a9-4aec9398bca0 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:29.537490 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-5aee15f1-d705-4cc4-a844-0f8d1eec7074 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:07:29.538451 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-5aee15f1-d705-4cc4-a844-0f8d1eec7074 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: d5f49055-da38-486c-9f10-1658c64d46f5] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:29.545416 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-5aee15f1-d705-4cc4-a844-0f8d1eec7074 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:29.546104 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-5aee15f1-d705-4cc4-a844-0f8d1eec7074 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:29.546907 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-5aee15f1-d705-4cc4-a844-0f8d1eec7074 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:29.547372 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-5aee15f1-d705-4cc4-a844-0f8d1eec7074 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:29.662479 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-598f5d05-1684-4a6e-87a9-4aec9398bca0 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "POST /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84/action" status: 200 len: 27738 microversion: 2.20 time: 0.171275 Jan 28 02:07:29.663368 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 112/229] 10.222.0.79 () {62 vars in 1318 bytes} [Fri Jan 28 02:07:29 2022] POST /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84/action => generated 27738 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:07:29.698591 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-5aee15f1-d705-4cc4-a844-0f8d1eec7074 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "POST /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5/action" status: 200 len: 23786 microversion: 2.1 time: 0.164505 Jan 28 02:07:29.699477 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 118/230] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Jan 28 02:07:29 2022] POST /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5/action => generated 23786 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 02:07:29.805569 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-2bc6498b-5e73-4130-87dc-a6d0bc46fdae tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:07:29.807752 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-2bc6498b-5e73-4130-87dc-a6d0bc46fdae tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] [instance: 2f0bfba5-38f6-4375-a6bf-25959ad11fe0] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:29.813994 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2bc6498b-5e73-4130-87dc-a6d0bc46fdae tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:29.814433 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2bc6498b-5e73-4130-87dc-a6d0bc46fdae tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:29.815191 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2bc6498b-5e73-4130-87dc-a6d0bc46fdae tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:29.815621 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2bc6498b-5e73-4130-87dc-a6d0bc46fdae tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:29.951067 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-2bc6498b-5e73-4130-87dc-a6d0bc46fdae tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd7039b8f074a13b2030a2bb7aaff94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc19a0f9c33f47f1b504bebbb0b2c931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:29.958398 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-2bc6498b-5e73-4130-87dc-a6d0bc46fdae tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] 10.222.0.79 "GET /compute/v2.1/servers/2f0bfba5-38f6-4375-a6bf-25959ad11fe0" status: 200 len: 1521 microversion: 2.1 time: 0.157063 Jan 28 02:07:29.958963 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 113/231] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:07:29 2022] GET /compute/v2.1/servers/2f0bfba5-38f6-4375-a6bf-25959ad11fe0 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:07:30.086995 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-c2f49a43-7551-4907-8b55-c0b0c9dad351 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:07:30.087696 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-c2f49a43-7551-4907-8b55-c0b0c9dad351 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] [instance: c564cd2f-07df-4c91-9190-30cb5e9cb3ea] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:30.094478 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-c2f49a43-7551-4907-8b55-c0b0c9dad351 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:30.094920 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-c2f49a43-7551-4907-8b55-c0b0c9dad351 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:30.095750 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-c2f49a43-7551-4907-8b55-c0b0c9dad351 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:30.096149 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-c2f49a43-7551-4907-8b55-c0b0c9dad351 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:30.111404 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.wsgi [None req-c2f49a43-7551-4907-8b55-c0b0c9dad351 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] HTTP exception thrown: Instance c564cd2f-07df-4c91-9190-30cb5e9cb3ea could not be found. Jan 28 02:07:30.112027 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-c2f49a43-7551-4907-8b55-c0b0c9dad351 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Returning 404 to user: Instance c564cd2f-07df-4c91-9190-30cb5e9cb3ea could not be found. {{(pid=116374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 02:07:30.112855 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-c2f49a43-7551-4907-8b55-c0b0c9dad351 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] 10.222.0.79 "DELETE /compute/v2.1/servers/c564cd2f-07df-4c91-9190-30cb5e9cb3ea" status: 404 len: 111 microversion: 2.1 time: 0.029855 Jan 28 02:07:30.113396 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 119/232] 10.222.0.79 () {58 vars in 1238 bytes} [Fri Jan 28 02:07:30 2022] DELETE /compute/v2.1/servers/c564cd2f-07df-4c91-9190-30cb5e9cb3ea => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 02:07:30.129535 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-a47f641a-dce5-454c-92b4-d167949326a3 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:07:30.129535 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-a47f641a-dce5-454c-92b4-d167949326a3 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] [instance: c564cd2f-07df-4c91-9190-30cb5e9cb3ea] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:30.129535 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a47f641a-dce5-454c-92b4-d167949326a3 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:30.130052 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a47f641a-dce5-454c-92b4-d167949326a3 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:30.131080 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a47f641a-dce5-454c-92b4-d167949326a3 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:30.131751 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a47f641a-dce5-454c-92b4-d167949326a3 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:30.148095 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.wsgi [None req-a47f641a-dce5-454c-92b4-d167949326a3 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] HTTP exception thrown: Instance c564cd2f-07df-4c91-9190-30cb5e9cb3ea could not be found. Jan 28 02:07:30.148686 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-a47f641a-dce5-454c-92b4-d167949326a3 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] Returning 404 to user: Instance c564cd2f-07df-4c91-9190-30cb5e9cb3ea could not be found. {{(pid=116375) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 02:07:30.149495 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-a47f641a-dce5-454c-92b4-d167949326a3 tempest-DeleteServersTestJSON-731086738 tempest-DeleteServersTestJSON-731086738-project] 10.222.0.79 "GET /compute/v2.1/servers/c564cd2f-07df-4c91-9190-30cb5e9cb3ea" status: 404 len: 111 microversion: 2.1 time: 0.031642 Jan 28 02:07:30.150092 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 114/233] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:07:30 2022] GET /compute/v2.1/servers/c564cd2f-07df-4c91-9190-30cb5e9cb3ea => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 02:07:30.675941 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-3076d833-9cbc-4abb-aea7-950d1ad843a8 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:07:30.676871 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-3076d833-9cbc-4abb-aea7-950d1ad843a8 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:30.682805 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-3076d833-9cbc-4abb-aea7-950d1ad843a8 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:30.683453 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-3076d833-9cbc-4abb-aea7-950d1ad843a8 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:30.684255 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-3076d833-9cbc-4abb-aea7-950d1ad843a8 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:30.684685 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-3076d833-9cbc-4abb-aea7-950d1ad843a8 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:30.714331 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-f0e980c0-465e-4409-93dd-6dde7038dbee tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:07:30.714819 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-f0e980c0-465e-4409-93dd-6dde7038dbee tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: d5f49055-da38-486c-9f10-1658c64d46f5] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:30.723815 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f0e980c0-465e-4409-93dd-6dde7038dbee tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:30.724490 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f0e980c0-465e-4409-93dd-6dde7038dbee tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:30.731086 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f0e980c0-465e-4409-93dd-6dde7038dbee tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:30.731086 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f0e980c0-465e-4409-93dd-6dde7038dbee tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:30.810747 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-3076d833-9cbc-4abb-aea7-950d1ad843a8 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "POST /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84/action" status: 200 len: 28034 microversion: 2.20 time: 0.138361 Jan 28 02:07:30.812486 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 120/234] 10.222.0.79 () {62 vars in 1318 bytes} [Fri Jan 28 02:07:30 2022] POST /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84/action => generated 28034 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:07:30.845636 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-f0e980c0-465e-4409-93dd-6dde7038dbee tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "POST /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5/action" status: 200 len: 24315 microversion: 2.1 time: 0.138089 Jan 28 02:07:30.846494 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 115/235] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Jan 28 02:07:30 2022] POST /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5/action => generated 24315 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 02:07:30.976251 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-7ad0ea18-3870-4414-a0a8-f94f22798f45 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:07:30.977114 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-7ad0ea18-3870-4414-a0a8-f94f22798f45 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] [instance: 2f0bfba5-38f6-4375-a6bf-25959ad11fe0] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:30.986059 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-7ad0ea18-3870-4414-a0a8-f94f22798f45 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:30.986381 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-7ad0ea18-3870-4414-a0a8-f94f22798f45 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:30.987349 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-7ad0ea18-3870-4414-a0a8-f94f22798f45 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:30.988001 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-7ad0ea18-3870-4414-a0a8-f94f22798f45 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:31.120804 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-7ad0ea18-3870-4414-a0a8-f94f22798f45 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd7039b8f074a13b2030a2bb7aaff94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc19a0f9c33f47f1b504bebbb0b2c931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:31.129303 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-7ad0ea18-3870-4414-a0a8-f94f22798f45 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] 10.222.0.79 "GET /compute/v2.1/servers/2f0bfba5-38f6-4375-a6bf-25959ad11fe0" status: 200 len: 1521 microversion: 2.1 time: 0.156940 Jan 28 02:07:31.129866 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 121/236] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:07:30 2022] GET /compute/v2.1/servers/2f0bfba5-38f6-4375-a6bf-25959ad11fe0 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:07:31.822245 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-e1d55e44-0ebb-4cb8-9e7e-e0a014b2b2e8 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:07:31.827410 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-e1d55e44-0ebb-4cb8-9e7e-e0a014b2b2e8 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:31.830677 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-e1d55e44-0ebb-4cb8-9e7e-e0a014b2b2e8 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:31.831118 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-e1d55e44-0ebb-4cb8-9e7e-e0a014b2b2e8 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:31.831879 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-e1d55e44-0ebb-4cb8-9e7e-e0a014b2b2e8 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:31.832331 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-e1d55e44-0ebb-4cb8-9e7e-e0a014b2b2e8 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:31.858666 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-9a5bbd22-58f7-4878-9e6a-506a221c4e63 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:07:31.859776 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-9a5bbd22-58f7-4878-9e6a-506a221c4e63 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: d5f49055-da38-486c-9f10-1658c64d46f5] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:31.866639 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-9a5bbd22-58f7-4878-9e6a-506a221c4e63 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:31.867210 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-9a5bbd22-58f7-4878-9e6a-506a221c4e63 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:31.868025 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-9a5bbd22-58f7-4878-9e6a-506a221c4e63 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:31.868540 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-9a5bbd22-58f7-4878-9e6a-506a221c4e63 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:31.993206 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-9a5bbd22-58f7-4878-9e6a-506a221c4e63 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "POST /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5/action" status: 200 len: 25283 microversion: 2.1 time: 0.138700 Jan 28 02:07:31.994088 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 122/237] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Jan 28 02:07:31 2022] POST /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5/action => generated 25283 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 02:07:32.107814 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-e1d55e44-0ebb-4cb8-9e7e-e0a014b2b2e8 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "POST /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84/action" status: 200 len: 28215 microversion: 2.20 time: 0.289451 Jan 28 02:07:32.109939 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 116/238] 10.222.0.79 () {62 vars in 1318 bytes} [Fri Jan 28 02:07:31 2022] POST /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84/action => generated 28215 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 28 02:07:32.149582 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-86121209-6a17-4523-9229-d80eba9a852e tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:07:32.150368 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-86121209-6a17-4523-9229-d80eba9a852e tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] [instance: 2f0bfba5-38f6-4375-a6bf-25959ad11fe0] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:32.163802 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-86121209-6a17-4523-9229-d80eba9a852e tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:32.163802 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-86121209-6a17-4523-9229-d80eba9a852e tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:32.163802 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-86121209-6a17-4523-9229-d80eba9a852e tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:32.163802 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-86121209-6a17-4523-9229-d80eba9a852e tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:32.292734 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-86121209-6a17-4523-9229-d80eba9a852e tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd7039b8f074a13b2030a2bb7aaff94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc19a0f9c33f47f1b504bebbb0b2c931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:32.300694 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-86121209-6a17-4523-9229-d80eba9a852e tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] 10.222.0.79 "GET /compute/v2.1/servers/2f0bfba5-38f6-4375-a6bf-25959ad11fe0" status: 200 len: 1521 microversion: 2.1 time: 0.155965 Jan 28 02:07:32.301376 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 123/239] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:07:32 2022] GET /compute/v2.1/servers/2f0bfba5-38f6-4375-a6bf-25959ad11fe0 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:07:33.006108 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-ff7b5c12-43cd-4703-ba6f-dc665a69dd48 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:07:33.007114 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-ff7b5c12-43cd-4703-ba6f-dc665a69dd48 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: d5f49055-da38-486c-9f10-1658c64d46f5] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:33.014107 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ff7b5c12-43cd-4703-ba6f-dc665a69dd48 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:33.014569 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ff7b5c12-43cd-4703-ba6f-dc665a69dd48 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:33.016110 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ff7b5c12-43cd-4703-ba6f-dc665a69dd48 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:33.020686 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ff7b5c12-43cd-4703-ba6f-dc665a69dd48 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:33.121590 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-5250058b-5d87-4f48-8503-30f21abb878d tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:07:33.122774 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-5250058b-5d87-4f48-8503-30f21abb878d tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:33.129105 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-5250058b-5d87-4f48-8503-30f21abb878d tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:33.129843 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-5250058b-5d87-4f48-8503-30f21abb878d tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:33.132163 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-ff7b5c12-43cd-4703-ba6f-dc665a69dd48 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "POST /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5/action" status: 200 len: 25895 microversion: 2.1 time: 0.130425 Jan 28 02:07:33.132810 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 117/240] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Jan 28 02:07:33 2022] POST /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5/action => generated 25895 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 02:07:33.136783 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-5250058b-5d87-4f48-8503-30f21abb878d tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:33.137241 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-5250058b-5d87-4f48-8503-30f21abb878d tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:33.269203 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-5250058b-5d87-4f48-8503-30f21abb878d tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "POST /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84/action" status: 200 len: 28215 microversion: 2.20 time: 0.151398 Jan 28 02:07:33.270449 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 124/241] 10.222.0.79 () {62 vars in 1318 bytes} [Fri Jan 28 02:07:33 2022] POST /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84/action => generated 28215 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 28 02:07:33.318089 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-78062195-cc4e-4084-91a5-2150afe0e6db tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:07:33.318770 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-78062195-cc4e-4084-91a5-2150afe0e6db tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] [instance: 2f0bfba5-38f6-4375-a6bf-25959ad11fe0] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:33.325775 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-78062195-cc4e-4084-91a5-2150afe0e6db tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:33.326220 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-78062195-cc4e-4084-91a5-2150afe0e6db tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:33.326986 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-78062195-cc4e-4084-91a5-2150afe0e6db tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:33.327417 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-78062195-cc4e-4084-91a5-2150afe0e6db tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:33.746510 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-78062195-cc4e-4084-91a5-2150afe0e6db tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd7039b8f074a13b2030a2bb7aaff94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc19a0f9c33f47f1b504bebbb0b2c931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:33.754950 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-78062195-cc4e-4084-91a5-2150afe0e6db tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] 10.222.0.79 "GET /compute/v2.1/servers/2f0bfba5-38f6-4375-a6bf-25959ad11fe0" status: 200 len: 1521 microversion: 2.1 time: 0.440732 Jan 28 02:07:33.755922 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 118/242] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:07:33 2022] GET /compute/v2.1/servers/2f0bfba5-38f6-4375-a6bf-25959ad11fe0 => generated 1521 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:07:34.148836 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-2c4a8f95-fee1-495d-84a0-c16567ee68ec tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:07:34.158023 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-2c4a8f95-fee1-495d-84a0-c16567ee68ec tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: d5f49055-da38-486c-9f10-1658c64d46f5] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:34.165492 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-2c4a8f95-fee1-495d-84a0-c16567ee68ec tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:34.165916 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-2c4a8f95-fee1-495d-84a0-c16567ee68ec tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:34.167512 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-2c4a8f95-fee1-495d-84a0-c16567ee68ec tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:34.168104 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-2c4a8f95-fee1-495d-84a0-c16567ee68ec tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:34.276699 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-2c4a8f95-fee1-495d-84a0-c16567ee68ec tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "POST /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5/action" status: 200 len: 26553 microversion: 2.1 time: 0.134675 Jan 28 02:07:34.277627 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 125/243] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Jan 28 02:07:34 2022] POST /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5/action => generated 26553 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 02:07:34.282006 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-8c3730cd-f234-42a4-8cb1-8a48c9ed15b3 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:07:34.283785 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-8c3730cd-f234-42a4-8cb1-8a48c9ed15b3 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:34.295735 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-8c3730cd-f234-42a4-8cb1-8a48c9ed15b3 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:34.296419 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-8c3730cd-f234-42a4-8cb1-8a48c9ed15b3 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:34.297391 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-8c3730cd-f234-42a4-8cb1-8a48c9ed15b3 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:34.297871 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-8c3730cd-f234-42a4-8cb1-8a48c9ed15b3 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:34.412159 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-8c3730cd-f234-42a4-8cb1-8a48c9ed15b3 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "POST /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84/action" status: 200 len: 28215 microversion: 2.20 time: 0.134074 Jan 28 02:07:34.412850 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 119/244] 10.222.0.79 () {62 vars in 1318 bytes} [Fri Jan 28 02:07:34 2022] POST /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84/action => generated 28215 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 28 02:07:34.772259 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-2b89c8c0-c89c-4f13-baf1-c08376fa17df tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:07:34.772948 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-2b89c8c0-c89c-4f13-baf1-c08376fa17df tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] [instance: 2f0bfba5-38f6-4375-a6bf-25959ad11fe0] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:34.781512 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2b89c8c0-c89c-4f13-baf1-c08376fa17df tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:34.781964 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2b89c8c0-c89c-4f13-baf1-c08376fa17df tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:34.782733 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2b89c8c0-c89c-4f13-baf1-c08376fa17df tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:34.783354 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2b89c8c0-c89c-4f13-baf1-c08376fa17df tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:34.877644 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-92e58c7b-3a68-471d-8ed5-b2078ea96ead tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-193874177", "imageRef": "04805ce8-b0a0-41b2-b614-bfb5b752cc5d", "flavorRef": "452", "networks": [{"uuid": "a1afa762-f2ce-40be-8faa-e9c2b4144812"}]}} {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:07:34.939656 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.network.neutron [None req-92e58c7b-3a68-471d-8ed5-b2078ea96ead tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] validate_networks() for [('a1afa762-f2ce-40be-8faa-e9c2b4144812', None, None, None, None, None)] {{(pid=116374) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Jan 28 02:07:34.947028 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-2b89c8c0-c89c-4f13-baf1-c08376fa17df tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd7039b8f074a13b2030a2bb7aaff94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc19a0f9c33f47f1b504bebbb0b2c931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:34.957878 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-2b89c8c0-c89c-4f13-baf1-c08376fa17df tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] 10.222.0.79 "GET /compute/v2.1/servers/2f0bfba5-38f6-4375-a6bf-25959ad11fe0" status: 200 len: 1521 microversion: 2.1 time: 0.189459 Jan 28 02:07:34.958735 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 120/245] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:07:34 2022] GET /compute/v2.1/servers/2f0bfba5-38f6-4375-a6bf-25959ad11fe0 => generated 1521 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:07:35.294916 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-e6843771-1e49-487e-8f13-830aa40ab847 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:07:35.295961 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-e6843771-1e49-487e-8f13-830aa40ab847 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: d5f49055-da38-486c-9f10-1658c64d46f5] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:35.308265 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-e6843771-1e49-487e-8f13-830aa40ab847 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:35.308984 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-e6843771-1e49-487e-8f13-830aa40ab847 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:35.309972 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-e6843771-1e49-487e-8f13-830aa40ab847 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:35.311095 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-e6843771-1e49-487e-8f13-830aa40ab847 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:35.311714 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.virt.hardware [None req-92e58c7b-3a68-471d-8ed5-b2078ea96ead tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Flavor limits 0:0:0 {{(pid=116374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 02:07:35.312231 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.virt.hardware [None req-92e58c7b-3a68-471d-8ed5-b2078ea96ead tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Image limits 0:0:0 {{(pid=116374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 02:07:35.313363 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.virt.hardware [None req-92e58c7b-3a68-471d-8ed5-b2078ea96ead tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Flavor pref 0:0:0 {{(pid=116374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 02:07:35.313816 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.virt.hardware [None req-92e58c7b-3a68-471d-8ed5-b2078ea96ead tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Image pref 0:0:0 {{(pid=116374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 02:07:35.314441 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.virt.hardware [None req-92e58c7b-3a68-471d-8ed5-b2078ea96ead tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 02:07:35.323783 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-92e58c7b-3a68-471d-8ed5-b2078ea96ead tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:35.324376 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-92e58c7b-3a68-471d-8ed5-b2078ea96ead tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:35.325237 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-92e58c7b-3a68-471d-8ed5-b2078ea96ead tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:35.325660 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-92e58c7b-3a68-471d-8ed5-b2078ea96ead tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:35.346405 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.quota [None req-92e58c7b-3a68-471d-8ed5-b2078ea96ead tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Getting quotas for project 2b66ddee4c864aae90b738695dffbeb9. Resources: {'ram', 'cores', 'instances'} {{(pid=116374) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 02:07:35.349269 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.quota [None req-92e58c7b-3a68-471d-8ed5-b2078ea96ead tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Getting quotas for user b019715a14074e059730965913694e52 and project 2b66ddee4c864aae90b738695dffbeb9. Resources: {'ram', 'cores', 'instances'} {{(pid=116374) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 02:07:35.361358 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-92e58c7b-3a68-471d-8ed5-b2078ea96ead tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Going to run 1 instances... {{(pid=116374) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 02:07:35.365425 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-92e58c7b-3a68-471d-8ed5-b2078ea96ead tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] [instance: f6852bd3-1574-4ae7-a78f-16f07931687b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='04805ce8-b0a0-41b2-b614-bfb5b752cc5d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116374) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 02:07:35.453922 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-e6843771-1e49-487e-8f13-830aa40ab847 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "POST /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5/action" status: 200 len: 27173 microversion: 2.1 time: 0.168832 Jan 28 02:07:35.454632 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 121/246] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Jan 28 02:07:35 2022] POST /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5/action => generated 27173 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 02:07:35.460065 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-2d3c04b6-9546-4db5-b7d7-1754f427fcd1 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:07:35.461050 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-2d3c04b6-9546-4db5-b7d7-1754f427fcd1 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:35.468731 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2d3c04b6-9546-4db5-b7d7-1754f427fcd1 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:35.469169 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2d3c04b6-9546-4db5-b7d7-1754f427fcd1 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:35.469924 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2d3c04b6-9546-4db5-b7d7-1754f427fcd1 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:35.470350 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2d3c04b6-9546-4db5-b7d7-1754f427fcd1 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:35.585634 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-92e58c7b-3a68-471d-8ed5-b2078ea96ead tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.867480 Jan 28 02:07:35.592263 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 126/247] 10.222.0.79 () {60 vars in 1146 bytes} [Fri Jan 28 02:07:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 875 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 28 02:07:35.597049 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-ab522a10-199a-4806-8634-96572f759f7e tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:07:35.597772 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-ab522a10-199a-4806-8634-96572f759f7e tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] [instance: f6852bd3-1574-4ae7-a78f-16f07931687b] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:35.602854 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-2d3c04b6-9546-4db5-b7d7-1754f427fcd1 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "POST /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84/action" status: 200 len: 28506 microversion: 2.20 time: 0.146532 Jan 28 02:07:35.603708 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 122/248] 10.222.0.79 () {62 vars in 1318 bytes} [Fri Jan 28 02:07:35 2022] POST /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84/action => generated 28506 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:07:35.656816 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-ab522a10-199a-4806-8634-96572f759f7e tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b019715a14074e059730965913694e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b66ddee4c864aae90b738695dffbeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:35.663690 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-ab522a10-199a-4806-8634-96572f759f7e tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] 10.222.0.79 "GET /compute/v2.1/servers/f6852bd3-1574-4ae7-a78f-16f07931687b" status: 200 len: 1217 microversion: 2.1 time: 0.070365 Jan 28 02:07:35.664476 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 127/249] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:07:35 2022] GET /compute/v2.1/servers/f6852bd3-1574-4ae7-a78f-16f07931687b => generated 1217 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:07:35.977215 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-94b2513f-efd7-4045-9937-c51c15875650 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:07:35.978019 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-94b2513f-efd7-4045-9937-c51c15875650 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] [instance: 2f0bfba5-38f6-4375-a6bf-25959ad11fe0] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:35.985196 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-94b2513f-efd7-4045-9937-c51c15875650 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:35.985655 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-94b2513f-efd7-4045-9937-c51c15875650 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:35.986425 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-94b2513f-efd7-4045-9937-c51c15875650 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:35.986906 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-94b2513f-efd7-4045-9937-c51c15875650 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:36.114028 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-94b2513f-efd7-4045-9937-c51c15875650 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd7039b8f074a13b2030a2bb7aaff94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc19a0f9c33f47f1b504bebbb0b2c931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:36.119589 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-94b2513f-efd7-4045-9937-c51c15875650 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] 10.222.0.79 "GET /compute/v2.1/servers/2f0bfba5-38f6-4375-a6bf-25959ad11fe0" status: 200 len: 1521 microversion: 2.1 time: 0.146400 Jan 28 02:07:36.120549 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 123/250] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:07:35 2022] GET /compute/v2.1/servers/2f0bfba5-38f6-4375-a6bf-25959ad11fe0 => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:07:36.468274 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-8747e44f-50bd-495f-9b58-f0b1d6093ff5 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:07:36.469247 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-8747e44f-50bd-495f-9b58-f0b1d6093ff5 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: d5f49055-da38-486c-9f10-1658c64d46f5] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:36.476476 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-8747e44f-50bd-495f-9b58-f0b1d6093ff5 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:36.476920 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-8747e44f-50bd-495f-9b58-f0b1d6093ff5 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:36.479712 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-8747e44f-50bd-495f-9b58-f0b1d6093ff5 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:36.479712 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-8747e44f-50bd-495f-9b58-f0b1d6093ff5 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:36.577830 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-8747e44f-50bd-495f-9b58-f0b1d6093ff5 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "POST /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5/action" status: 200 len: 27643 microversion: 2.1 time: 0.114425 Jan 28 02:07:36.579346 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 128/251] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Jan 28 02:07:36 2022] POST /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5/action => generated 27643 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 02:07:36.618694 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-52f8245a-2b00-40da-bfdb-a92c907bf748 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:07:36.619934 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-52f8245a-2b00-40da-bfdb-a92c907bf748 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:36.625764 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-52f8245a-2b00-40da-bfdb-a92c907bf748 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:36.626196 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-52f8245a-2b00-40da-bfdb-a92c907bf748 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:36.626946 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-52f8245a-2b00-40da-bfdb-a92c907bf748 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:36.627369 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-52f8245a-2b00-40da-bfdb-a92c907bf748 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:36.680773 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-7a89ed57-8c3b-4758-abb7-8ebaeec16928 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:07:36.681457 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-7a89ed57-8c3b-4758-abb7-8ebaeec16928 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] [instance: f6852bd3-1574-4ae7-a78f-16f07931687b] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:36.738012 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-52f8245a-2b00-40da-bfdb-a92c907bf748 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "POST /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84/action" status: 200 len: 28506 microversion: 2.20 time: 0.122830 Jan 28 02:07:36.738913 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 124/252] 10.222.0.79 () {62 vars in 1318 bytes} [Fri Jan 28 02:07:36 2022] POST /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84/action => generated 28506 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 28 02:07:36.739125 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-7a89ed57-8c3b-4758-abb7-8ebaeec16928 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b019715a14074e059730965913694e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b66ddee4c864aae90b738695dffbeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:36.745978 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-7a89ed57-8c3b-4758-abb7-8ebaeec16928 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] 10.222.0.79 "GET /compute/v2.1/servers/f6852bd3-1574-4ae7-a78f-16f07931687b" status: 200 len: 1217 microversion: 2.1 time: 0.069675 Jan 28 02:07:36.746532 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 129/253] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:07:36 2022] GET /compute/v2.1/servers/f6852bd3-1574-4ae7-a78f-16f07931687b => generated 1217 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:07:36.991568 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-8330fcd3-0a77-4eba-8094-667be5a5a5f3 tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1127303952", "imageRef": "04805ce8-b0a0-41b2-b614-bfb5b752cc5d", "flavorRef": "452"}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:07:37.044693 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.network.neutron [None req-8330fcd3-0a77-4eba-8094-667be5a5a5f3 tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] validate_networks() for None {{(pid=116375) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Jan 28 02:07:37.137402 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-9ec107f3-0dd3-4e7b-b5d7-eb0fe5d0a75d tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:07:37.138010 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-9ec107f3-0dd3-4e7b-b5d7-eb0fe5d0a75d tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] [instance: 2f0bfba5-38f6-4375-a6bf-25959ad11fe0] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:37.153086 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-9ec107f3-0dd3-4e7b-b5d7-eb0fe5d0a75d tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:37.153526 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-9ec107f3-0dd3-4e7b-b5d7-eb0fe5d0a75d tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:37.154295 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-9ec107f3-0dd3-4e7b-b5d7-eb0fe5d0a75d tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:37.154722 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-9ec107f3-0dd3-4e7b-b5d7-eb0fe5d0a75d tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:37.377072 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.virt.hardware [None req-8330fcd3-0a77-4eba-8094-667be5a5a5f3 tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] Flavor limits 0:0:0 {{(pid=116375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 02:07:37.377496 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.virt.hardware [None req-8330fcd3-0a77-4eba-8094-667be5a5a5f3 tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] Image limits 0:0:0 {{(pid=116375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 02:07:37.377963 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.virt.hardware [None req-8330fcd3-0a77-4eba-8094-667be5a5a5f3 tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] Flavor pref 0:0:0 {{(pid=116375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 02:07:37.378369 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.virt.hardware [None req-8330fcd3-0a77-4eba-8094-667be5a5a5f3 tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] Image pref 0:0:0 {{(pid=116375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 02:07:37.378775 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.virt.hardware [None req-8330fcd3-0a77-4eba-8094-667be5a5a5f3 tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 02:07:37.380400 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-9ec107f3-0dd3-4e7b-b5d7-eb0fe5d0a75d tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd7039b8f074a13b2030a2bb7aaff94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc19a0f9c33f47f1b504bebbb0b2c931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:37.389750 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-8330fcd3-0a77-4eba-8094-667be5a5a5f3 tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:37.389969 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-9ec107f3-0dd3-4e7b-b5d7-eb0fe5d0a75d tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] 10.222.0.79 "GET /compute/v2.1/servers/2f0bfba5-38f6-4375-a6bf-25959ad11fe0" status: 200 len: 1521 microversion: 2.1 time: 0.256728 Jan 28 02:07:37.390215 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-8330fcd3-0a77-4eba-8094-667be5a5a5f3 tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:37.390561 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 130/254] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:07:37 2022] GET /compute/v2.1/servers/2f0bfba5-38f6-4375-a6bf-25959ad11fe0 => generated 1521 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:07:37.391279 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-8330fcd3-0a77-4eba-8094-667be5a5a5f3 tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:37.391719 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-8330fcd3-0a77-4eba-8094-667be5a5a5f3 tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:37.408504 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.quota [None req-8330fcd3-0a77-4eba-8094-667be5a5a5f3 tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] Getting quotas for project 328131fd3ad64205a4928d00c2bb8c23. Resources: {'ram', 'cores', 'instances'} {{(pid=116375) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 02:07:37.412522 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.quota [None req-8330fcd3-0a77-4eba-8094-667be5a5a5f3 tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] Getting quotas for user bd5d9ed0db1e4efcad0dfddb7291c658 and project 328131fd3ad64205a4928d00c2bb8c23. Resources: {'ram', 'cores', 'instances'} {{(pid=116375) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 02:07:37.423227 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-8330fcd3-0a77-4eba-8094-667be5a5a5f3 tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] Going to run 1 instances... {{(pid=116375) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 02:07:37.425713 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-8330fcd3-0a77-4eba-8094-667be5a5a5f3 tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] [instance: a6a959a9-19ae-4499-8baf-4079dc64c783] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='04805ce8-b0a0-41b2-b614-bfb5b752cc5d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116375) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 02:07:37.589428 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-8330fcd3-0a77-4eba-8094-667be5a5a5f3 tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.602242 Jan 28 02:07:37.590192 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 125/255] 10.222.0.79 () {60 vars in 1146 bytes} [Fri Jan 28 02:07:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 604 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 28 02:07:37.591713 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-8fc8e88a-84a9-4902-ba63-eab74c505ffd tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:07:37.592839 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-8fc8e88a-84a9-4902-ba63-eab74c505ffd tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: d5f49055-da38-486c-9f10-1658c64d46f5] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:37.598855 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-8fc8e88a-84a9-4902-ba63-eab74c505ffd tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:37.599357 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-8fc8e88a-84a9-4902-ba63-eab74c505ffd tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:37.600085 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-8fc8e88a-84a9-4902-ba63-eab74c505ffd tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:37.600566 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-8fc8e88a-84a9-4902-ba63-eab74c505ffd tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:37.601322 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-bc36e6f2-7be5-43c9-a595-fabe6fec5ce9 tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:07:37.605967 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-bc36e6f2-7be5-43c9-a595-fabe6fec5ce9 tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] [instance: a6a959a9-19ae-4499-8baf-4079dc64c783] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:37.660743 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-bc36e6f2-7be5-43c9-a595-fabe6fec5ce9 tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5d9ed0db1e4efcad0dfddb7291c658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328131fd3ad64205a4928d00c2bb8c23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:37.668261 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-bc36e6f2-7be5-43c9-a595-fabe6fec5ce9 tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] 10.222.0.79 "GET /compute/v2.1/servers/a6a959a9-19ae-4499-8baf-4079dc64c783" status: 200 len: 1215 microversion: 2.1 time: 0.071407 Jan 28 02:07:37.672331 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 126/256] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:07:37 2022] GET /compute/v2.1/servers/a6a959a9-19ae-4499-8baf-4079dc64c783 => generated 1215 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:07:37.750047 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-1cad2c6f-d4d2-4e1a-8e46-387773372eeb tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:07:37.751049 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-1cad2c6f-d4d2-4e1a-8e46-387773372eeb tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:37.757313 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-1cad2c6f-d4d2-4e1a-8e46-387773372eeb tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:37.757765 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-1cad2c6f-d4d2-4e1a-8e46-387773372eeb tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:37.758560 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-1cad2c6f-d4d2-4e1a-8e46-387773372eeb tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:37.758992 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-1cad2c6f-d4d2-4e1a-8e46-387773372eeb tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:37.773640 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-8fc8e88a-84a9-4902-ba63-eab74c505ffd tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "POST /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5/action" status: 200 len: 27915 microversion: 2.1 time: 0.187705 Jan 28 02:07:37.776792 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 131/257] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Jan 28 02:07:37 2022] POST /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5/action => generated 27915 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 02:07:37.779936 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-bf657230-2124-4264-87e9-9965e6b03e1a tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:07:37.780901 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-bf657230-2124-4264-87e9-9965e6b03e1a tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] [instance: f6852bd3-1574-4ae7-a78f-16f07931687b] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:37.788696 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-bf657230-2124-4264-87e9-9965e6b03e1a tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:37.789146 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-bf657230-2124-4264-87e9-9965e6b03e1a tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:37.789931 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-bf657230-2124-4264-87e9-9965e6b03e1a tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:37.790387 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-bf657230-2124-4264-87e9-9965e6b03e1a tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:37.851320 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-bf657230-2124-4264-87e9-9965e6b03e1a tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b019715a14074e059730965913694e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b66ddee4c864aae90b738695dffbeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:37.858825 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-bf657230-2124-4264-87e9-9965e6b03e1a tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] 10.222.0.79 "GET /compute/v2.1/servers/f6852bd3-1574-4ae7-a78f-16f07931687b" status: 200 len: 1269 microversion: 2.1 time: 0.083091 Jan 28 02:07:37.859405 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 132/258] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:07:37 2022] GET /compute/v2.1/servers/f6852bd3-1574-4ae7-a78f-16f07931687b => generated 1269 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:07:37.920428 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-1cad2c6f-d4d2-4e1a-8e46-387773372eeb tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "POST /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84/action" status: 200 len: 28672 microversion: 2.20 time: 0.173936 Jan 28 02:07:37.921312 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 127/259] 10.222.0.79 () {62 vars in 1318 bytes} [Fri Jan 28 02:07:37 2022] POST /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84/action => generated 28672 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 28 02:07:38.408085 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-55796242-4fec-44ba-b21d-4ddedda7f7d5 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:07:38.408836 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-55796242-4fec-44ba-b21d-4ddedda7f7d5 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] [instance: 2f0bfba5-38f6-4375-a6bf-25959ad11fe0] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:38.414951 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-55796242-4fec-44ba-b21d-4ddedda7f7d5 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:38.415473 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-55796242-4fec-44ba-b21d-4ddedda7f7d5 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:38.417359 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-55796242-4fec-44ba-b21d-4ddedda7f7d5 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:38.417877 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-55796242-4fec-44ba-b21d-4ddedda7f7d5 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:38.543186 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-55796242-4fec-44ba-b21d-4ddedda7f7d5 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd7039b8f074a13b2030a2bb7aaff94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc19a0f9c33f47f1b504bebbb0b2c931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:38.550655 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-55796242-4fec-44ba-b21d-4ddedda7f7d5 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] 10.222.0.79 "GET /compute/v2.1/servers/2f0bfba5-38f6-4375-a6bf-25959ad11fe0" status: 200 len: 1521 microversion: 2.1 time: 0.146384 Jan 28 02:07:38.551232 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 133/260] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:07:38 2022] GET /compute/v2.1/servers/2f0bfba5-38f6-4375-a6bf-25959ad11fe0 => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:07:38.685853 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-83161c72-73e8-4044-a43a-22a276b13cbf tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:07:38.686617 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-83161c72-73e8-4044-a43a-22a276b13cbf tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] [instance: a6a959a9-19ae-4499-8baf-4079dc64c783] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:38.693128 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-83161c72-73e8-4044-a43a-22a276b13cbf tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:38.693637 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-83161c72-73e8-4044-a43a-22a276b13cbf tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:38.694460 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-83161c72-73e8-4044-a43a-22a276b13cbf tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:38.694886 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-83161c72-73e8-4044-a43a-22a276b13cbf tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:38.756368 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-83161c72-73e8-4044-a43a-22a276b13cbf tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5d9ed0db1e4efcad0dfddb7291c658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328131fd3ad64205a4928d00c2bb8c23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:38.764467 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-83161c72-73e8-4044-a43a-22a276b13cbf tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] 10.222.0.79 "GET /compute/v2.1/servers/a6a959a9-19ae-4499-8baf-4079dc64c783" status: 200 len: 1219 microversion: 2.1 time: 0.082812 Jan 28 02:07:38.765020 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 128/261] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:07:38 2022] GET /compute/v2.1/servers/a6a959a9-19ae-4499-8baf-4079dc64c783 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:07:38.785128 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-73197a50-9c9b-4c68-a745-2001031edd8b tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:07:38.786060 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-73197a50-9c9b-4c68-a745-2001031edd8b tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: d5f49055-da38-486c-9f10-1658c64d46f5] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:38.792985 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-73197a50-9c9b-4c68-a745-2001031edd8b tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:38.793434 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-73197a50-9c9b-4c68-a745-2001031edd8b tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:38.794204 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-73197a50-9c9b-4c68-a745-2001031edd8b tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:38.794820 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-73197a50-9c9b-4c68-a745-2001031edd8b tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:38.875845 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-fce06d7a-f3fe-453d-8b60-5d406e11acfa tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:07:38.876590 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-fce06d7a-f3fe-453d-8b60-5d406e11acfa tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] [instance: f6852bd3-1574-4ae7-a78f-16f07931687b] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:38.882570 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-fce06d7a-f3fe-453d-8b60-5d406e11acfa tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:38.882955 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-fce06d7a-f3fe-453d-8b60-5d406e11acfa tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:38.883828 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-fce06d7a-f3fe-453d-8b60-5d406e11acfa tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:38.884398 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-fce06d7a-f3fe-453d-8b60-5d406e11acfa tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:38.951280 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-fce06d7a-f3fe-453d-8b60-5d406e11acfa tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b019715a14074e059730965913694e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b66ddee4c864aae90b738695dffbeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:38.958661 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-fce06d7a-f3fe-453d-8b60-5d406e11acfa tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] 10.222.0.79 "GET /compute/v2.1/servers/f6852bd3-1574-4ae7-a78f-16f07931687b" status: 200 len: 1277 microversion: 2.1 time: 0.086484 Jan 28 02:07:38.959219 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 129/262] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:07:38 2022] GET /compute/v2.1/servers/f6852bd3-1574-4ae7-a78f-16f07931687b => generated 1277 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:07:38.964334 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-6b9c7f2f-fe36-4db6-8ddc-ee75e854c495 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:07:38.965235 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-6b9c7f2f-fe36-4db6-8ddc-ee75e854c495 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:38.971045 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-6b9c7f2f-fe36-4db6-8ddc-ee75e854c495 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:38.971486 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-6b9c7f2f-fe36-4db6-8ddc-ee75e854c495 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:38.972290 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-6b9c7f2f-fe36-4db6-8ddc-ee75e854c495 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:38.972724 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-6b9c7f2f-fe36-4db6-8ddc-ee75e854c495 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:41.455960 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-73197a50-9c9b-4c68-a745-2001031edd8b tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "POST /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5/action" status: 200 len: 28171 microversion: 2.1 time: 2.674251 Jan 28 02:07:41.456635 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 134/263] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Jan 28 02:07:38 2022] POST /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5/action => generated 28171 bytes in 2676 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 02:07:41.461447 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-d7584da7-3b69-4853-bc71-7beacf7fb384 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:07:41.468161 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-d7584da7-3b69-4853-bc71-7beacf7fb384 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] [instance: 2f0bfba5-38f6-4375-a6bf-25959ad11fe0] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:41.468912 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-d7584da7-3b69-4853-bc71-7beacf7fb384 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:41.469361 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-d7584da7-3b69-4853-bc71-7beacf7fb384 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:41.470131 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-d7584da7-3b69-4853-bc71-7beacf7fb384 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:41.470562 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-d7584da7-3b69-4853-bc71-7beacf7fb384 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:41.480874 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-6b9c7f2f-fe36-4db6-8ddc-ee75e854c495 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "POST /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84/action" status: 200 len: 28672 microversion: 2.20 time: 2.520153 Jan 28 02:07:41.481530 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 130/264] 10.222.0.79 () {62 vars in 1318 bytes} [Fri Jan 28 02:07:38 2022] POST /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84/action => generated 28672 bytes in 2522 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:07:41.487728 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-8dfba30b-d266-4dbf-8b05-30ce8a1fb728 tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:07:41.488452 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-8dfba30b-d266-4dbf-8b05-30ce8a1fb728 tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] [instance: a6a959a9-19ae-4499-8baf-4079dc64c783] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:41.495676 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-8dfba30b-d266-4dbf-8b05-30ce8a1fb728 tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:41.496696 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-8dfba30b-d266-4dbf-8b05-30ce8a1fb728 tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:41.496961 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-8dfba30b-d266-4dbf-8b05-30ce8a1fb728 tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:41.497395 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-8dfba30b-d266-4dbf-8b05-30ce8a1fb728 tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:41.571497 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-8dfba30b-d266-4dbf-8b05-30ce8a1fb728 tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5d9ed0db1e4efcad0dfddb7291c658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328131fd3ad64205a4928d00c2bb8c23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:41.580645 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-8dfba30b-d266-4dbf-8b05-30ce8a1fb728 tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] 10.222.0.79 "GET /compute/v2.1/servers/a6a959a9-19ae-4499-8baf-4079dc64c783" status: 200 len: 1219 microversion: 2.1 time: 0.097865 Jan 28 02:07:41.582832 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 131/265] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:07:41 2022] GET /compute/v2.1/servers/a6a959a9-19ae-4499-8baf-4079dc64c783 => generated 1219 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:07:41.593998 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-2fbd9993-b859-42f8-8c1c-3d82265e76ed tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:07:41.594704 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-2fbd9993-b859-42f8-8c1c-3d82265e76ed tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] [instance: f6852bd3-1574-4ae7-a78f-16f07931687b] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:41.601094 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2fbd9993-b859-42f8-8c1c-3d82265e76ed tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:41.601618 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2fbd9993-b859-42f8-8c1c-3d82265e76ed tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:41.602653 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2fbd9993-b859-42f8-8c1c-3d82265e76ed tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:41.603484 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2fbd9993-b859-42f8-8c1c-3d82265e76ed tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:41.686859 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-2fbd9993-b859-42f8-8c1c-3d82265e76ed tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b019715a14074e059730965913694e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b66ddee4c864aae90b738695dffbeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:41.695184 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-2fbd9993-b859-42f8-8c1c-3d82265e76ed tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] 10.222.0.79 "GET /compute/v2.1/servers/f6852bd3-1574-4ae7-a78f-16f07931687b" status: 200 len: 1287 microversion: 2.1 time: 0.112429 Jan 28 02:07:41.696066 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 132/266] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:07:41 2022] GET /compute/v2.1/servers/f6852bd3-1574-4ae7-a78f-16f07931687b => generated 1287 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:07:41.713882 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-d7584da7-3b69-4853-bc71-7beacf7fb384 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd7039b8f074a13b2030a2bb7aaff94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc19a0f9c33f47f1b504bebbb0b2c931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:41.721562 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-d7584da7-3b69-4853-bc71-7beacf7fb384 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] 10.222.0.79 "GET /compute/v2.1/servers/2f0bfba5-38f6-4375-a6bf-25959ad11fe0" status: 200 len: 1521 microversion: 2.1 time: 0.263825 Jan 28 02:07:41.722123 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 135/267] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:07:41 2022] GET /compute/v2.1/servers/2f0bfba5-38f6-4375-a6bf-25959ad11fe0 => generated 1521 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:07:42.468378 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-2dc9cf77-f8e4-4533-88a6-998e5ead331a tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:07:42.469201 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-2dc9cf77-f8e4-4533-88a6-998e5ead331a tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: d5f49055-da38-486c-9f10-1658c64d46f5] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:42.474877 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2dc9cf77-f8e4-4533-88a6-998e5ead331a tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:42.475299 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2dc9cf77-f8e4-4533-88a6-998e5ead331a tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:42.476116 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2dc9cf77-f8e4-4533-88a6-998e5ead331a tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:42.476543 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2dc9cf77-f8e4-4533-88a6-998e5ead331a tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:42.493287 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-fe83dd27-3db1-49bf-9290-973e6c937de3 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:07:42.494203 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-fe83dd27-3db1-49bf-9290-973e6c937de3 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:42.504447 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-fe83dd27-3db1-49bf-9290-973e6c937de3 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:42.504885 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-fe83dd27-3db1-49bf-9290-973e6c937de3 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:42.505892 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-fe83dd27-3db1-49bf-9290-973e6c937de3 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:42.506317 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-fe83dd27-3db1-49bf-9290-973e6c937de3 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:43.075798 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-fe83dd27-3db1-49bf-9290-973e6c937de3 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "POST /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84/action" status: 200 len: 28672 microversion: 2.20 time: 0.585663 Jan 28 02:07:43.080122 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 136/268] 10.222.0.79 () {62 vars in 1318 bytes} [Fri Jan 28 02:07:42 2022] POST /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84/action => generated 28672 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 28 02:07:43.081737 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-e1ae394c-37fd-4564-af1d-1c9339ab95bf tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:07:43.082421 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-e1ae394c-37fd-4564-af1d-1c9339ab95bf tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] [instance: a6a959a9-19ae-4499-8baf-4079dc64c783] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:43.089051 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-e1ae394c-37fd-4564-af1d-1c9339ab95bf tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:43.089604 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-e1ae394c-37fd-4564-af1d-1c9339ab95bf tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:43.090988 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-e1ae394c-37fd-4564-af1d-1c9339ab95bf tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:43.091706 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-e1ae394c-37fd-4564-af1d-1c9339ab95bf tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:43.095067 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-2dc9cf77-f8e4-4533-88a6-998e5ead331a tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "POST /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5/action" status: 200 len: 28171 microversion: 2.1 time: 0.630683 Jan 28 02:07:43.095758 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 133/269] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Jan 28 02:07:42 2022] POST /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5/action => generated 28171 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 02:07:43.101102 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-1a98eaf2-d5cf-4507-b1b8-388d59812722 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:07:43.101789 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-1a98eaf2-d5cf-4507-b1b8-388d59812722 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] [instance: f6852bd3-1574-4ae7-a78f-16f07931687b] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:43.109119 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-1a98eaf2-d5cf-4507-b1b8-388d59812722 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:43.109486 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-1a98eaf2-d5cf-4507-b1b8-388d59812722 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:43.110332 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-1a98eaf2-d5cf-4507-b1b8-388d59812722 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:43.110760 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-1a98eaf2-d5cf-4507-b1b8-388d59812722 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:43.208350 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-e1ae394c-37fd-4564-af1d-1c9339ab95bf tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5d9ed0db1e4efcad0dfddb7291c658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328131fd3ad64205a4928d00c2bb8c23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:43.216829 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-e1ae394c-37fd-4564-af1d-1c9339ab95bf tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] 10.222.0.79 "GET /compute/v2.1/servers/a6a959a9-19ae-4499-8baf-4079dc64c783" status: 200 len: 1267 microversion: 2.1 time: 0.138736 Jan 28 02:07:43.217518 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 137/270] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:07:43 2022] GET /compute/v2.1/servers/a6a959a9-19ae-4499-8baf-4079dc64c783 => generated 1267 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:07:43.230875 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-45a22178-db5e-4574-b6fa-772cd315af3d tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:07:43.234763 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-45a22178-db5e-4574-b6fa-772cd315af3d tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] [instance: 2f0bfba5-38f6-4375-a6bf-25959ad11fe0] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:43.237687 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-45a22178-db5e-4574-b6fa-772cd315af3d tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:43.238145 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-45a22178-db5e-4574-b6fa-772cd315af3d tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:43.238887 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-45a22178-db5e-4574-b6fa-772cd315af3d tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:43.239312 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-45a22178-db5e-4574-b6fa-772cd315af3d tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:43.398027 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-1a98eaf2-d5cf-4507-b1b8-388d59812722 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b019715a14074e059730965913694e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b66ddee4c864aae90b738695dffbeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:43.406360 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-1a98eaf2-d5cf-4507-b1b8-388d59812722 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] 10.222.0.79 "GET /compute/v2.1/servers/f6852bd3-1574-4ae7-a78f-16f07931687b" status: 200 len: 1317 microversion: 2.1 time: 0.309122 Jan 28 02:07:43.406937 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 134/271] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:07:43 2022] GET /compute/v2.1/servers/f6852bd3-1574-4ae7-a78f-16f07931687b => generated 1317 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:07:43.412630 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [req-a5230986-2af6-4b15-a66e-830c2357f9fe req-11e079a3-e90c-481a-8b11-41b7bfd77a48 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6852bd3-1574-4ae7-a78f-16f07931687b", "tag": "9f5a06ae-9758-488e-b71f-7103e118fef7"}]} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:07:43.415611 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:07:43.415611 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: warnings.warn(msg) Jan 28 02:07:43.425195 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-a5230986-2af6-4b15-a66e-830c2357f9fe req-11e079a3-e90c-481a-8b11-41b7bfd77a48 service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:43.425639 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-a5230986-2af6-4b15-a66e-830c2357f9fe req-11e079a3-e90c-481a-8b11-41b7bfd77a48 service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:43.437750 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.compute.server_external_events [req-a5230986-2af6-4b15-a66e-830c2357f9fe req-11e079a3-e90c-481a-8b11-41b7bfd77a48 service nova] Creating event network-changed:9f5a06ae-9758-488e-b71f-7103e118fef7 for instance f6852bd3-1574-4ae7-a78f-16f07931687b on hv-cinder-82497 Jan 28 02:07:43.442546 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [req-a5230986-2af6-4b15-a66e-830c2357f9fe req-11e079a3-e90c-481a-8b11-41b7bfd77a48 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034009 Jan 28 02:07:43.444496 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 135/272] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Jan 28 02:07:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:07:43.531248 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-45a22178-db5e-4574-b6fa-772cd315af3d tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd7039b8f074a13b2030a2bb7aaff94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc19a0f9c33f47f1b504bebbb0b2c931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:43.538493 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-45a22178-db5e-4574-b6fa-772cd315af3d tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] 10.222.0.79 "GET /compute/v2.1/servers/2f0bfba5-38f6-4375-a6bf-25959ad11fe0" status: 200 len: 1521 microversion: 2.1 time: 0.311241 Jan 28 02:07:43.539057 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 138/273] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:07:43 2022] GET /compute/v2.1/servers/2f0bfba5-38f6-4375-a6bf-25959ad11fe0 => generated 1521 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:07:44.088597 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-a32b290d-2dc6-475d-b620-af06012bdca1 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:07:44.089582 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-a32b290d-2dc6-475d-b620-af06012bdca1 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:44.096834 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a32b290d-2dc6-475d-b620-af06012bdca1 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:44.097400 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a32b290d-2dc6-475d-b620-af06012bdca1 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:44.098013 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a32b290d-2dc6-475d-b620-af06012bdca1 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:44.098430 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a32b290d-2dc6-475d-b620-af06012bdca1 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:44.106672 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-6ab38942-7bc7-4d74-9ce9-114c708c32c9 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:07:44.107635 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-6ab38942-7bc7-4d74-9ce9-114c708c32c9 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: d5f49055-da38-486c-9f10-1658c64d46f5] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:44.113805 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-6ab38942-7bc7-4d74-9ce9-114c708c32c9 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:44.114242 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-6ab38942-7bc7-4d74-9ce9-114c708c32c9 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:44.114996 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-6ab38942-7bc7-4d74-9ce9-114c708c32c9 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:44.115690 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-6ab38942-7bc7-4d74-9ce9-114c708c32c9 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:44.294439 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-a32b290d-2dc6-475d-b620-af06012bdca1 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "POST /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84/action" status: 200 len: 28672 microversion: 2.20 time: 0.209317 Jan 28 02:07:44.295504 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 136/274] 10.222.0.79 () {62 vars in 1318 bytes} [Fri Jan 28 02:07:44 2022] POST /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84/action => generated 28672 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:07:44.301545 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-fa4548ff-896f-48a4-8671-16bde66eb7c1 tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:07:44.302421 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-fa4548ff-896f-48a4-8671-16bde66eb7c1 tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] [instance: a6a959a9-19ae-4499-8baf-4079dc64c783] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:44.310115 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-fa4548ff-896f-48a4-8671-16bde66eb7c1 tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:44.310839 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-fa4548ff-896f-48a4-8671-16bde66eb7c1 tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:44.311499 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-fa4548ff-896f-48a4-8671-16bde66eb7c1 tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:44.311932 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-fa4548ff-896f-48a4-8671-16bde66eb7c1 tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:44.328277 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-6ab38942-7bc7-4d74-9ce9-114c708c32c9 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "POST /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5/action" status: 200 len: 28171 microversion: 2.1 time: 0.225116 Jan 28 02:07:44.329403 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 139/275] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Jan 28 02:07:44 2022] POST /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5/action => generated 28171 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 02:07:44.425976 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-06367ca9-0dc5-4a37-bcac-a858f25a7144 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:07:44.426956 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-06367ca9-0dc5-4a37-bcac-a858f25a7144 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] [instance: f6852bd3-1574-4ae7-a78f-16f07931687b] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:44.428600 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-fa4548ff-896f-48a4-8671-16bde66eb7c1 tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5d9ed0db1e4efcad0dfddb7291c658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328131fd3ad64205a4928d00c2bb8c23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:44.435214 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-06367ca9-0dc5-4a37-bcac-a858f25a7144 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:44.436136 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-06367ca9-0dc5-4a37-bcac-a858f25a7144 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:44.437312 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-06367ca9-0dc5-4a37-bcac-a858f25a7144 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:44.437893 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-06367ca9-0dc5-4a37-bcac-a858f25a7144 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:44.439021 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-fa4548ff-896f-48a4-8671-16bde66eb7c1 tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] 10.222.0.79 "GET /compute/v2.1/servers/a6a959a9-19ae-4499-8baf-4079dc64c783" status: 200 len: 1273 microversion: 2.1 time: 0.142019 Jan 28 02:07:44.440261 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 137/276] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:07:44 2022] GET /compute/v2.1/servers/a6a959a9-19ae-4499-8baf-4079dc64c783 => generated 1273 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:07:44.556181 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-1bb54814-253e-4748-981e-67bfb357f5ed tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:07:44.556633 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-1bb54814-253e-4748-981e-67bfb357f5ed tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] [instance: 2f0bfba5-38f6-4375-a6bf-25959ad11fe0] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:44.563279 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-1bb54814-253e-4748-981e-67bfb357f5ed tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:44.563722 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-1bb54814-253e-4748-981e-67bfb357f5ed tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:44.564584 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-1bb54814-253e-4748-981e-67bfb357f5ed tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:44.565163 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-1bb54814-253e-4748-981e-67bfb357f5ed tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:45.063754 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-06367ca9-0dc5-4a37-bcac-a858f25a7144 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b019715a14074e059730965913694e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b66ddee4c864aae90b738695dffbeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:45.070831 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-06367ca9-0dc5-4a37-bcac-a858f25a7144 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] 10.222.0.79 "GET /compute/v2.1/servers/f6852bd3-1574-4ae7-a78f-16f07931687b" status: 200 len: 1317 microversion: 2.1 time: 0.648819 Jan 28 02:07:45.071393 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 140/277] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:07:44 2022] GET /compute/v2.1/servers/f6852bd3-1574-4ae7-a78f-16f07931687b => generated 1317 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:07:45.126829 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-1bb54814-253e-4748-981e-67bfb357f5ed tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd7039b8f074a13b2030a2bb7aaff94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc19a0f9c33f47f1b504bebbb0b2c931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:45.134368 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-1bb54814-253e-4748-981e-67bfb357f5ed tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] 10.222.0.79 "GET /compute/v2.1/servers/2f0bfba5-38f6-4375-a6bf-25959ad11fe0" status: 200 len: 1501 microversion: 2.1 time: 0.582097 Jan 28 02:07:45.135074 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 138/278] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:07:44 2022] GET /compute/v2.1/servers/2f0bfba5-38f6-4375-a6bf-25959ad11fe0 => generated 1501 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:07:45.153559 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-d391dcce-2dae-4947-af89-f65c62eaaf2f tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:07:45.154128 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-d391dcce-2dae-4947-af89-f65c62eaaf2f tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] [instance: ec5e47ac-761b-467f-958c-516a9f8bc3e6] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:45.159961 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-d391dcce-2dae-4947-af89-f65c62eaaf2f tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:45.160436 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-d391dcce-2dae-4947-af89-f65c62eaaf2f tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:45.161201 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-d391dcce-2dae-4947-af89-f65c62eaaf2f tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:45.161629 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-d391dcce-2dae-4947-af89-f65c62eaaf2f tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:45.307116 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-48ea5ce8-b94a-4e50-b381-a64ad5ff9c71 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:07:45.308213 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-48ea5ce8-b94a-4e50-b381-a64ad5ff9c71 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:45.315996 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-48ea5ce8-b94a-4e50-b381-a64ad5ff9c71 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:45.316624 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-48ea5ce8-b94a-4e50-b381-a64ad5ff9c71 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:45.317622 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-48ea5ce8-b94a-4e50-b381-a64ad5ff9c71 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:45.318059 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-48ea5ce8-b94a-4e50-b381-a64ad5ff9c71 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:45.434047 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-48ea5ce8-b94a-4e50-b381-a64ad5ff9c71 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "POST /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84/action" status: 200 len: 28672 microversion: 2.20 time: 0.130795 Jan 28 02:07:45.436113 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 139/279] 10.222.0.79 () {62 vars in 1318 bytes} [Fri Jan 28 02:07:45 2022] POST /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84/action => generated 28672 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 28 02:07:45.439410 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-d391dcce-2dae-4947-af89-f65c62eaaf2f tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd7039b8f074a13b2030a2bb7aaff94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc19a0f9c33f47f1b504bebbb0b2c931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:45.442399 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-ea400256-1804-4955-bd75-93f66e863bfe tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:07:45.443783 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-ea400256-1804-4955-bd75-93f66e863bfe tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: d5f49055-da38-486c-9f10-1658c64d46f5] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:45.447721 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-d391dcce-2dae-4947-af89-f65c62eaaf2f tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] 10.222.0.79 "GET /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6" status: 200 len: 1515 microversion: 2.1 time: 0.298508 Jan 28 02:07:45.450673 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 141/280] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:07:45 2022] GET /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6 => generated 1515 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:07:45.453766 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ea400256-1804-4955-bd75-93f66e863bfe tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:45.454275 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ea400256-1804-4955-bd75-93f66e863bfe tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:45.455577 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ea400256-1804-4955-bd75-93f66e863bfe tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:45.455577 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ea400256-1804-4955-bd75-93f66e863bfe tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:45.459176 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-edbbc149-3ec6-47da-8bac-5e0da2faa23e tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:07:45.460809 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-edbbc149-3ec6-47da-8bac-5e0da2faa23e tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] [instance: a6a959a9-19ae-4499-8baf-4079dc64c783] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:45.479353 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-edbbc149-3ec6-47da-8bac-5e0da2faa23e tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:45.479813 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-edbbc149-3ec6-47da-8bac-5e0da2faa23e tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:45.480623 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-edbbc149-3ec6-47da-8bac-5e0da2faa23e tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:45.481614 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-edbbc149-3ec6-47da-8bac-5e0da2faa23e tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:45.576485 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-ea400256-1804-4955-bd75-93f66e863bfe tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "POST /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5/action" status: 200 len: 28462 microversion: 2.1 time: 0.137639 Jan 28 02:07:45.577532 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 140/281] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Jan 28 02:07:45 2022] POST /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5/action => generated 28462 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 02:07:45.643296 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-edbbc149-3ec6-47da-8bac-5e0da2faa23e tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5d9ed0db1e4efcad0dfddb7291c658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328131fd3ad64205a4928d00c2bb8c23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:45.650990 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-edbbc149-3ec6-47da-8bac-5e0da2faa23e tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] 10.222.0.79 "GET /compute/v2.1/servers/a6a959a9-19ae-4499-8baf-4079dc64c783" status: 200 len: 1315 microversion: 2.1 time: 0.197577 Jan 28 02:07:45.651754 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 142/282] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:07:45 2022] GET /compute/v2.1/servers/a6a959a9-19ae-4499-8baf-4079dc64c783 => generated 1315 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:07:46.088544 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-6e9501e8-eee1-4e23-868e-f4187e60ea11 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:07:46.089241 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-6e9501e8-eee1-4e23-868e-f4187e60ea11 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] [instance: f6852bd3-1574-4ae7-a78f-16f07931687b] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:46.096215 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-6e9501e8-eee1-4e23-868e-f4187e60ea11 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:46.096726 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-6e9501e8-eee1-4e23-868e-f4187e60ea11 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:46.097690 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-6e9501e8-eee1-4e23-868e-f4187e60ea11 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:46.098184 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-6e9501e8-eee1-4e23-868e-f4187e60ea11 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:46.451234 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-e312d44a-bebb-4290-b961-9a943339eb0f tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:07:46.457307 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-e312d44a-bebb-4290-b961-9a943339eb0f tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:46.464158 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-6e9501e8-eee1-4e23-868e-f4187e60ea11 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b019715a14074e059730965913694e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b66ddee4c864aae90b738695dffbeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:46.469685 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-e312d44a-bebb-4290-b961-9a943339eb0f tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:46.470140 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-e312d44a-bebb-4290-b961-9a943339eb0f tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:46.470923 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-e312d44a-bebb-4290-b961-9a943339eb0f tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:46.471351 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-e312d44a-bebb-4290-b961-9a943339eb0f tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:46.479485 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-6e9501e8-eee1-4e23-868e-f4187e60ea11 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] 10.222.0.79 "GET /compute/v2.1/servers/f6852bd3-1574-4ae7-a78f-16f07931687b" status: 200 len: 1317 microversion: 2.1 time: 0.395052 Jan 28 02:07:46.480099 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 141/283] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:07:46 2022] GET /compute/v2.1/servers/f6852bd3-1574-4ae7-a78f-16f07931687b => generated 1317 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:07:46.588974 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-09a0b227-05b9-4f7d-99fd-5eaad61acefc tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:07:46.590859 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-09a0b227-05b9-4f7d-99fd-5eaad61acefc tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: d5f49055-da38-486c-9f10-1658c64d46f5] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:46.598295 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-e312d44a-bebb-4290-b961-9a943339eb0f tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "POST /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84/action" status: 200 len: 28697 microversion: 2.20 time: 0.152420 Jan 28 02:07:46.598587 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-09a0b227-05b9-4f7d-99fd-5eaad61acefc tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:46.599476 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-09a0b227-05b9-4f7d-99fd-5eaad61acefc tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:46.600333 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-09a0b227-05b9-4f7d-99fd-5eaad61acefc tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:46.601004 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-09a0b227-05b9-4f7d-99fd-5eaad61acefc tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:46.604720 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 143/284] 10.222.0.79 () {62 vars in 1318 bytes} [Fri Jan 28 02:07:46 2022] POST /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84/action => generated 28697 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 28 02:07:46.687108 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-2df692ff-7afb-415b-951c-ec85cdefe34c tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:07:46.688216 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-2df692ff-7afb-415b-951c-ec85cdefe34c tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] [instance: a6a959a9-19ae-4499-8baf-4079dc64c783] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:46.697807 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-2df692ff-7afb-415b-951c-ec85cdefe34c tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:46.697807 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-2df692ff-7afb-415b-951c-ec85cdefe34c tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:46.698676 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-2df692ff-7afb-415b-951c-ec85cdefe34c tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:46.699176 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-2df692ff-7afb-415b-951c-ec85cdefe34c tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:46.723685 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-09a0b227-05b9-4f7d-99fd-5eaad61acefc tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "POST /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5/action" status: 200 len: 28513 microversion: 2.1 time: 0.138786 Jan 28 02:07:46.724453 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 142/285] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Jan 28 02:07:46 2022] POST /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5/action => generated 28513 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 02:07:46.847625 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [req-f52a38f7-1d9c-4a7b-a875-5b5c1860835c req-9d139e78-d2a4-4d37-b59c-418034197f32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6a959a9-19ae-4499-8baf-4079dc64c783", "tag": "6a5dc122-96f8-4b70-a7b2-fd97f86dcdfc"}]} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:07:46.855920 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:07:46.855920 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: warnings.warn(msg) Jan 28 02:07:46.858479 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-f52a38f7-1d9c-4a7b-a875-5b5c1860835c req-9d139e78-d2a4-4d37-b59c-418034197f32 service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:46.858950 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-f52a38f7-1d9c-4a7b-a875-5b5c1860835c req-9d139e78-d2a4-4d37-b59c-418034197f32 service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:46.870789 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.compute.server_external_events [req-f52a38f7-1d9c-4a7b-a875-5b5c1860835c req-9d139e78-d2a4-4d37-b59c-418034197f32 service nova] Creating event network-changed:6a5dc122-96f8-4b70-a7b2-fd97f86dcdfc for instance a6a959a9-19ae-4499-8baf-4079dc64c783 on hv-cinder-82497 Jan 28 02:07:46.883379 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [req-f52a38f7-1d9c-4a7b-a875-5b5c1860835c req-9d139e78-d2a4-4d37-b59c-418034197f32 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048136 Jan 28 02:07:46.885010 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 143/286] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Jan 28 02:07:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:07:46.998719 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-2df692ff-7afb-415b-951c-ec85cdefe34c tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5d9ed0db1e4efcad0dfddb7291c658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328131fd3ad64205a4928d00c2bb8c23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:47.006195 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-2df692ff-7afb-415b-951c-ec85cdefe34c tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] 10.222.0.79 "GET /compute/v2.1/servers/a6a959a9-19ae-4499-8baf-4079dc64c783" status: 200 len: 1315 microversion: 2.1 time: 0.324295 Jan 28 02:07:47.006777 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 144/287] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:07:46 2022] GET /compute/v2.1/servers/a6a959a9-19ae-4499-8baf-4079dc64c783 => generated 1315 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:07:47.493174 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-be9741ca-b3aa-4e38-bcb8-7b58b98b41f9 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:07:47.494281 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-be9741ca-b3aa-4e38-bcb8-7b58b98b41f9 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] [instance: ec5e47ac-761b-467f-958c-516a9f8bc3e6] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:47.498250 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-d961f903-77ae-45d6-a464-34bbd31968cb tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:07:47.498853 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-d961f903-77ae-45d6-a464-34bbd31968cb tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] [instance: f6852bd3-1574-4ae7-a78f-16f07931687b] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:47.501589 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-be9741ca-b3aa-4e38-bcb8-7b58b98b41f9 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:47.502365 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-be9741ca-b3aa-4e38-bcb8-7b58b98b41f9 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:47.503153 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-be9741ca-b3aa-4e38-bcb8-7b58b98b41f9 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:47.503586 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-be9741ca-b3aa-4e38-bcb8-7b58b98b41f9 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:47.504903 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-d961f903-77ae-45d6-a464-34bbd31968cb tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:47.505345 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-d961f903-77ae-45d6-a464-34bbd31968cb tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:47.506301 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-d961f903-77ae-45d6-a464-34bbd31968cb tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:47.506733 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-d961f903-77ae-45d6-a464-34bbd31968cb tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:47.532120 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.objects.instance [None req-be9741ca-b3aa-4e38-bcb8-7b58b98b41f9 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lazy-loading 'flavor' on Instance uuid ec5e47ac-761b-467f-958c-516a9f8bc3e6 {{(pid=116375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jan 28 02:07:47.796123 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-d961f903-77ae-45d6-a464-34bbd31968cb tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b019715a14074e059730965913694e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b66ddee4c864aae90b738695dffbeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:47.806282 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-d961f903-77ae-45d6-a464-34bbd31968cb tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] 10.222.0.79 "GET /compute/v2.1/servers/f6852bd3-1574-4ae7-a78f-16f07931687b" status: 200 len: 1317 microversion: 2.1 time: 0.311825 Jan 28 02:07:47.807493 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 145/288] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:07:47 2022] GET /compute/v2.1/servers/f6852bd3-1574-4ae7-a78f-16f07931687b => generated 1317 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:07:47.816105 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-b5f88bc4-ccb2-4906-8022-f8072f1dd831 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:07:47.817327 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-b5f88bc4-ccb2-4906-8022-f8072f1dd831 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:47.839216 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-b5f88bc4-ccb2-4906-8022-f8072f1dd831 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:47.847004 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-b5f88bc4-ccb2-4906-8022-f8072f1dd831 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:47.847004 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-b5f88bc4-ccb2-4906-8022-f8072f1dd831 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:47.847198 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-be9741ca-b3aa-4e38-bcb8-7b58b98b41f9 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] 10.222.0.79 "POST /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6/action" status: 200 len: 32 microversion: 2.1 time: 0.356473 Jan 28 02:07:47.847278 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-b5f88bc4-ccb2-4906-8022-f8072f1dd831 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:47.847363 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 144/289] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Jan 28 02:07:47 2022] POST /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6/action => generated 32 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 02:07:47.876104 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-d557ee1d-a4f0-4e07-b840-6fedfd498645 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:07:47.879218 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-d557ee1d-a4f0-4e07-b840-6fedfd498645 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: d5f49055-da38-486c-9f10-1658c64d46f5] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:47.899498 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-d557ee1d-a4f0-4e07-b840-6fedfd498645 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:47.899923 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-d557ee1d-a4f0-4e07-b840-6fedfd498645 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:47.900809 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-d557ee1d-a4f0-4e07-b840-6fedfd498645 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:47.904856 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-d557ee1d-a4f0-4e07-b840-6fedfd498645 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:48.035224 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-b5f88bc4-ccb2-4906-8022-f8072f1dd831 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "POST /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84/action" status: 200 len: 30375 microversion: 2.20 time: 0.226158 Jan 28 02:07:48.035866 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 146/290] 10.222.0.79 () {62 vars in 1318 bytes} [Fri Jan 28 02:07:47 2022] POST /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84/action => generated 30375 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:07:48.041373 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-95396e85-b3b4-405e-8b0a-86e7505f0910 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:07:48.042102 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-95396e85-b3b4-405e-8b0a-86e7505f0910 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] [instance: ec5e47ac-761b-467f-958c-516a9f8bc3e6] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:48.049161 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-95396e85-b3b4-405e-8b0a-86e7505f0910 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:48.049359 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-95396e85-b3b4-405e-8b0a-86e7505f0910 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:48.059651 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-95396e85-b3b4-405e-8b0a-86e7505f0910 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:48.059651 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-95396e85-b3b4-405e-8b0a-86e7505f0910 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:48.099096 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-d557ee1d-a4f0-4e07-b840-6fedfd498645 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "POST /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5/action" status: 200 len: 28628 microversion: 2.1 time: 0.252120 Jan 28 02:07:48.099757 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 145/291] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Jan 28 02:07:47 2022] POST /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5/action => generated 28628 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 02:07:48.104770 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-43e74359-7530-4b93-8ff1-bf18b885f309 tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:07:48.105537 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-43e74359-7530-4b93-8ff1-bf18b885f309 tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] [instance: a6a959a9-19ae-4499-8baf-4079dc64c783] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:48.112983 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-43e74359-7530-4b93-8ff1-bf18b885f309 tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:48.113428 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-43e74359-7530-4b93-8ff1-bf18b885f309 tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:48.114207 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-43e74359-7530-4b93-8ff1-bf18b885f309 tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:48.114635 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-43e74359-7530-4b93-8ff1-bf18b885f309 tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:48.306419 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-95396e85-b3b4-405e-8b0a-86e7505f0910 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd7039b8f074a13b2030a2bb7aaff94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc19a0f9c33f47f1b504bebbb0b2c931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:48.314876 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-95396e85-b3b4-405e-8b0a-86e7505f0910 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] 10.222.0.79 "GET /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6" status: 200 len: 1521 microversion: 2.1 time: 0.277659 Jan 28 02:07:48.323260 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 147/292] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:07:48 2022] GET /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6 => generated 1521 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:07:48.393259 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-43e74359-7530-4b93-8ff1-bf18b885f309 tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5d9ed0db1e4efcad0dfddb7291c658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328131fd3ad64205a4928d00c2bb8c23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:48.402038 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-43e74359-7530-4b93-8ff1-bf18b885f309 tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] 10.222.0.79 "GET /compute/v2.1/servers/a6a959a9-19ae-4499-8baf-4079dc64c783" status: 200 len: 1315 microversion: 2.1 time: 0.300960 Jan 28 02:07:48.411989 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 146/293] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:07:48 2022] GET /compute/v2.1/servers/a6a959a9-19ae-4499-8baf-4079dc64c783 => generated 1315 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:07:48.619562 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [req-2ebf32f6-9b9f-47cc-847d-4f999f65781f req-691f8f38-06f0-4a7c-a9b0-e16555cc48cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6852bd3-1574-4ae7-a78f-16f07931687b", "name": "network-vif-plugged", "status": "completed", "tag": "9f5a06ae-9758-488e-b71f-7103e118fef7"}]} {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:07:48.621104 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:07:48.621104 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: warnings.warn(msg) Jan 28 02:07:48.628783 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [req-2ebf32f6-9b9f-47cc-847d-4f999f65781f req-691f8f38-06f0-4a7c-a9b0-e16555cc48cc service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:48.629294 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [req-2ebf32f6-9b9f-47cc-847d-4f999f65781f req-691f8f38-06f0-4a7c-a9b0-e16555cc48cc service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:48.649753 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.compute.server_external_events [req-2ebf32f6-9b9f-47cc-847d-4f999f65781f req-691f8f38-06f0-4a7c-a9b0-e16555cc48cc service nova] Creating event network-vif-plugged:9f5a06ae-9758-488e-b71f-7103e118fef7 for instance f6852bd3-1574-4ae7-a78f-16f07931687b on hv-cinder-82497 Jan 28 02:07:48.657668 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [req-2ebf32f6-9b9f-47cc-847d-4f999f65781f req-691f8f38-06f0-4a7c-a9b0-e16555cc48cc service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042019 Jan 28 02:07:48.658863 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 148/294] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Jan 28 02:07:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:07:48.823799 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-37f02b4c-5b4c-492d-b780-c669599f9694 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:07:48.825106 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-37f02b4c-5b4c-492d-b780-c669599f9694 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] [instance: f6852bd3-1574-4ae7-a78f-16f07931687b] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:48.831755 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-37f02b4c-5b4c-492d-b780-c669599f9694 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:48.832362 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-37f02b4c-5b4c-492d-b780-c669599f9694 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:48.833363 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-37f02b4c-5b4c-492d-b780-c669599f9694 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:48.833842 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-37f02b4c-5b4c-492d-b780-c669599f9694 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:48.989925 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-37f02b4c-5b4c-492d-b780-c669599f9694 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b019715a14074e059730965913694e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b66ddee4c864aae90b738695dffbeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:48.989925 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-37f02b4c-5b4c-492d-b780-c669599f9694 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] 10.222.0.79 "GET /compute/v2.1/servers/f6852bd3-1574-4ae7-a78f-16f07931687b" status: 200 len: 1317 microversion: 2.1 time: 0.159913 Jan 28 02:07:48.989925 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 147/295] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:07:48 2022] GET /compute/v2.1/servers/f6852bd3-1574-4ae7-a78f-16f07931687b => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:07:49.051248 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-8973966f-565b-4779-bc83-c36ce1734eed tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:07:49.052387 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-8973966f-565b-4779-bc83-c36ce1734eed tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:49.058663 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-8973966f-565b-4779-bc83-c36ce1734eed tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:49.059695 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-8973966f-565b-4779-bc83-c36ce1734eed tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:49.060873 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-8973966f-565b-4779-bc83-c36ce1734eed tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:49.061356 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-8973966f-565b-4779-bc83-c36ce1734eed tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:49.116554 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-7de13366-0e37-4b75-972b-2d61e6232f48 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:07:49.117533 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-7de13366-0e37-4b75-972b-2d61e6232f48 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: d5f49055-da38-486c-9f10-1658c64d46f5] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:49.125199 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-7de13366-0e37-4b75-972b-2d61e6232f48 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:49.125729 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-7de13366-0e37-4b75-972b-2d61e6232f48 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:49.126593 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-7de13366-0e37-4b75-972b-2d61e6232f48 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:49.127004 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-7de13366-0e37-4b75-972b-2d61e6232f48 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:49.234933 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-8973966f-565b-4779-bc83-c36ce1734eed tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "POST /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84/action" status: 200 len: 31719 microversion: 2.20 time: 0.188463 Jan 28 02:07:49.235595 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 149/296] 10.222.0.79 () {62 vars in 1318 bytes} [Fri Jan 28 02:07:49 2022] POST /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84/action => generated 31719 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:07:49.265132 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-7de13366-0e37-4b75-972b-2d61e6232f48 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "POST /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5/action" status: 200 len: 28628 microversion: 2.1 time: 0.157262 Jan 28 02:07:49.268880 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 148/297] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Jan 28 02:07:49 2022] POST /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5/action => generated 28628 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 02:07:49.343282 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-3c664f16-46d7-4cc0-8424-6351a490d76e tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:07:49.343981 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-3c664f16-46d7-4cc0-8424-6351a490d76e tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] [instance: ec5e47ac-761b-467f-958c-516a9f8bc3e6] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:49.350323 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-3c664f16-46d7-4cc0-8424-6351a490d76e tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:49.350769 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-3c664f16-46d7-4cc0-8424-6351a490d76e tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:49.351535 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-3c664f16-46d7-4cc0-8424-6351a490d76e tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:49.351966 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-3c664f16-46d7-4cc0-8424-6351a490d76e tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:49.419817 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-a8cdfbba-597d-43d7-b8dd-fc9d859bab8d tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:07:49.420761 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-a8cdfbba-597d-43d7-b8dd-fc9d859bab8d tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] [instance: a6a959a9-19ae-4499-8baf-4079dc64c783] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:49.427414 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a8cdfbba-597d-43d7-b8dd-fc9d859bab8d tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:49.428073 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a8cdfbba-597d-43d7-b8dd-fc9d859bab8d tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:49.428945 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a8cdfbba-597d-43d7-b8dd-fc9d859bab8d tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:49.429389 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a8cdfbba-597d-43d7-b8dd-fc9d859bab8d tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:49.553047 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-3c664f16-46d7-4cc0-8424-6351a490d76e tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd7039b8f074a13b2030a2bb7aaff94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc19a0f9c33f47f1b504bebbb0b2c931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:49.570580 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-3c664f16-46d7-4cc0-8424-6351a490d76e tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] 10.222.0.79 "GET /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6" status: 200 len: 1521 microversion: 2.1 time: 0.231452 Jan 28 02:07:49.571344 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 150/298] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:07:49 2022] GET /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6 => generated 1521 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:07:49.611899 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-a8cdfbba-597d-43d7-b8dd-fc9d859bab8d tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5d9ed0db1e4efcad0dfddb7291c658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328131fd3ad64205a4928d00c2bb8c23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:49.623477 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-a8cdfbba-597d-43d7-b8dd-fc9d859bab8d tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] 10.222.0.79 "GET /compute/v2.1/servers/a6a959a9-19ae-4499-8baf-4079dc64c783" status: 200 len: 1315 microversion: 2.1 time: 0.206270 Jan 28 02:07:49.630897 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 149/299] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:07:49 2022] GET /compute/v2.1/servers/a6a959a9-19ae-4499-8baf-4079dc64c783 => generated 1315 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:07:49.998198 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-34b9ec48-9751-4503-91f4-c9aa73087be3 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:07:49.998721 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-34b9ec48-9751-4503-91f4-c9aa73087be3 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] [instance: f6852bd3-1574-4ae7-a78f-16f07931687b] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:50.005003 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-34b9ec48-9751-4503-91f4-c9aa73087be3 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:50.005451 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-34b9ec48-9751-4503-91f4-c9aa73087be3 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:50.006229 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-34b9ec48-9751-4503-91f4-c9aa73087be3 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:50.006683 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-34b9ec48-9751-4503-91f4-c9aa73087be3 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:50.208209 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-34b9ec48-9751-4503-91f4-c9aa73087be3 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b019715a14074e059730965913694e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b66ddee4c864aae90b738695dffbeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:50.216325 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-34b9ec48-9751-4503-91f4-c9aa73087be3 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] 10.222.0.79 "GET /compute/v2.1/servers/f6852bd3-1574-4ae7-a78f-16f07931687b" status: 200 len: 1317 microversion: 2.1 time: 0.222145 Jan 28 02:07:50.224097 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 151/300] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:07:49 2022] GET /compute/v2.1/servers/f6852bd3-1574-4ae7-a78f-16f07931687b => generated 1317 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:07:50.264597 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-eabda97b-b68d-4c4a-b1bd-93584a0662e2 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:07:50.265518 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-eabda97b-b68d-4c4a-b1bd-93584a0662e2 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:50.271287 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-eabda97b-b68d-4c4a-b1bd-93584a0662e2 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:50.271726 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-eabda97b-b68d-4c4a-b1bd-93584a0662e2 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:50.272702 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-eabda97b-b68d-4c4a-b1bd-93584a0662e2 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:50.273285 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-eabda97b-b68d-4c4a-b1bd-93584a0662e2 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:50.279846 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-b4dc010b-b5b0-4f16-9b20-8a0192cd26c5 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:07:50.287713 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-b4dc010b-b5b0-4f16-9b20-8a0192cd26c5 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: d5f49055-da38-486c-9f10-1658c64d46f5] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:50.291662 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-b4dc010b-b5b0-4f16-9b20-8a0192cd26c5 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:50.292383 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-b4dc010b-b5b0-4f16-9b20-8a0192cd26c5 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:50.293664 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-b4dc010b-b5b0-4f16-9b20-8a0192cd26c5 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:50.294229 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-b4dc010b-b5b0-4f16-9b20-8a0192cd26c5 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:50.495894 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-b4dc010b-b5b0-4f16-9b20-8a0192cd26c5 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "POST /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5/action" status: 200 len: 28628 microversion: 2.1 time: 0.222493 Jan 28 02:07:50.496625 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 152/301] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Jan 28 02:07:50 2022] POST /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5/action => generated 28628 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 02:07:50.538292 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-eabda97b-b68d-4c4a-b1bd-93584a0662e2 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "POST /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84/action" status: 200 len: 32598 microversion: 2.20 time: 0.281661 Jan 28 02:07:50.542341 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 150/302] 10.222.0.79 () {62 vars in 1318 bytes} [Fri Jan 28 02:07:50 2022] POST /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84/action => generated 32598 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:07:50.589192 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-fca7241a-cfd7-4174-ae19-a66586ec6077 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:07:50.589895 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-fca7241a-cfd7-4174-ae19-a66586ec6077 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] [instance: ec5e47ac-761b-467f-958c-516a9f8bc3e6] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:50.597202 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-fca7241a-cfd7-4174-ae19-a66586ec6077 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:50.597641 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-fca7241a-cfd7-4174-ae19-a66586ec6077 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:50.598405 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-fca7241a-cfd7-4174-ae19-a66586ec6077 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:50.598832 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-fca7241a-cfd7-4174-ae19-a66586ec6077 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:50.638647 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-67a574f3-2a7d-4b71-93f8-39a639fc057c tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:07:50.639618 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-67a574f3-2a7d-4b71-93f8-39a639fc057c tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] [instance: a6a959a9-19ae-4499-8baf-4079dc64c783] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:50.647507 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-67a574f3-2a7d-4b71-93f8-39a639fc057c tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:50.648403 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-67a574f3-2a7d-4b71-93f8-39a639fc057c tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:50.649265 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-67a574f3-2a7d-4b71-93f8-39a639fc057c tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:50.649705 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-67a574f3-2a7d-4b71-93f8-39a639fc057c tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:51.107831 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-fca7241a-cfd7-4174-ae19-a66586ec6077 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd7039b8f074a13b2030a2bb7aaff94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc19a0f9c33f47f1b504bebbb0b2c931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:51.116567 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-fca7241a-cfd7-4174-ae19-a66586ec6077 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] 10.222.0.79 "GET /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6" status: 200 len: 1521 microversion: 2.1 time: 0.531435 Jan 28 02:07:51.117407 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-67a574f3-2a7d-4b71-93f8-39a639fc057c tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5d9ed0db1e4efcad0dfddb7291c658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328131fd3ad64205a4928d00c2bb8c23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:51.118569 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 153/303] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:07:50 2022] GET /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6 => generated 1521 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:07:51.125958 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-67a574f3-2a7d-4b71-93f8-39a639fc057c tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] 10.222.0.79 "GET /compute/v2.1/servers/a6a959a9-19ae-4499-8baf-4079dc64c783" status: 200 len: 1315 microversion: 2.1 time: 0.491953 Jan 28 02:07:51.126527 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 151/304] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:07:50 2022] GET /compute/v2.1/servers/a6a959a9-19ae-4499-8baf-4079dc64c783 => generated 1315 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:07:51.234005 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-3c2a6ab8-b7f2-4297-8d08-f03f1b98d2e5 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:07:51.235196 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-3c2a6ab8-b7f2-4297-8d08-f03f1b98d2e5 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] [instance: f6852bd3-1574-4ae7-a78f-16f07931687b] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:51.241725 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-3c2a6ab8-b7f2-4297-8d08-f03f1b98d2e5 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:51.242451 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-3c2a6ab8-b7f2-4297-8d08-f03f1b98d2e5 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:51.243552 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-3c2a6ab8-b7f2-4297-8d08-f03f1b98d2e5 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:51.244371 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-3c2a6ab8-b7f2-4297-8d08-f03f1b98d2e5 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:51.397673 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-3c2a6ab8-b7f2-4297-8d08-f03f1b98d2e5 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b019715a14074e059730965913694e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b66ddee4c864aae90b738695dffbeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:51.407889 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-3c2a6ab8-b7f2-4297-8d08-f03f1b98d2e5 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] 10.222.0.79 "GET /compute/v2.1/servers/f6852bd3-1574-4ae7-a78f-16f07931687b" status: 200 len: 1317 microversion: 2.1 time: 0.177832 Jan 28 02:07:51.408560 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 154/305] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:07:51 2022] GET /compute/v2.1/servers/f6852bd3-1574-4ae7-a78f-16f07931687b => generated 1317 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:07:51.507780 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-1798e810-9ae3-428f-8b12-fc87c089a8c9 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:07:51.508724 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-1798e810-9ae3-428f-8b12-fc87c089a8c9 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: d5f49055-da38-486c-9f10-1658c64d46f5] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:51.515331 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-1798e810-9ae3-428f-8b12-fc87c089a8c9 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:51.515772 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-1798e810-9ae3-428f-8b12-fc87c089a8c9 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:51.518987 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-1798e810-9ae3-428f-8b12-fc87c089a8c9 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:51.518987 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-1798e810-9ae3-428f-8b12-fc87c089a8c9 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:51.551305 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-17477996-45e4-4101-8ed9-91cb4542f9fd tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:07:51.551583 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-17477996-45e4-4101-8ed9-91cb4542f9fd tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:51.559713 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-17477996-45e4-4101-8ed9-91cb4542f9fd tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:51.560387 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-17477996-45e4-4101-8ed9-91cb4542f9fd tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:51.561238 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-17477996-45e4-4101-8ed9-91cb4542f9fd tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:51.561685 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-17477996-45e4-4101-8ed9-91cb4542f9fd tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:51.652850 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-1798e810-9ae3-428f-8b12-fc87c089a8c9 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "POST /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5/action" status: 200 len: 28628 microversion: 2.1 time: 0.147461 Jan 28 02:07:51.656375 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 152/306] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Jan 28 02:07:51 2022] POST /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5/action => generated 28628 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 02:07:51.691032 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-17477996-45e4-4101-8ed9-91cb4542f9fd tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "POST /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84/action" status: 200 len: 33142 microversion: 2.20 time: 0.144208 Jan 28 02:07:51.691778 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 155/307] 10.222.0.79 () {62 vars in 1318 bytes} [Fri Jan 28 02:07:51 2022] POST /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84/action => generated 33142 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 28 02:07:52.144080 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-0e626f61-f848-444a-9894-f523ccb8c97a tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:07:52.145433 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-0e626f61-f848-444a-9894-f523ccb8c97a tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] [instance: ec5e47ac-761b-467f-958c-516a9f8bc3e6] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:52.146166 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-223df9e7-3f6d-466d-8391-39575388ec80 tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:07:52.146546 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-223df9e7-3f6d-466d-8391-39575388ec80 tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] [instance: a6a959a9-19ae-4499-8baf-4079dc64c783] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:52.153646 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-223df9e7-3f6d-466d-8391-39575388ec80 tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:52.154404 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-223df9e7-3f6d-466d-8391-39575388ec80 tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:52.155133 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-223df9e7-3f6d-466d-8391-39575388ec80 tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:52.155570 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-223df9e7-3f6d-466d-8391-39575388ec80 tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:52.162942 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-0e626f61-f848-444a-9894-f523ccb8c97a tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:52.163397 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-0e626f61-f848-444a-9894-f523ccb8c97a tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:52.164219 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-0e626f61-f848-444a-9894-f523ccb8c97a tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:52.170774 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-0e626f61-f848-444a-9894-f523ccb8c97a tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:52.351129 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-223df9e7-3f6d-466d-8391-39575388ec80 tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5d9ed0db1e4efcad0dfddb7291c658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328131fd3ad64205a4928d00c2bb8c23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:52.358941 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-223df9e7-3f6d-466d-8391-39575388ec80 tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] 10.222.0.79 "GET /compute/v2.1/servers/a6a959a9-19ae-4499-8baf-4079dc64c783" status: 200 len: 1315 microversion: 2.1 time: 0.218485 Jan 28 02:07:52.359515 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 156/308] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:07:52 2022] GET /compute/v2.1/servers/a6a959a9-19ae-4499-8baf-4079dc64c783 => generated 1315 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:07:52.363229 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-0e626f61-f848-444a-9894-f523ccb8c97a tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd7039b8f074a13b2030a2bb7aaff94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc19a0f9c33f47f1b504bebbb0b2c931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:52.372093 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-0e626f61-f848-444a-9894-f523ccb8c97a tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] 10.222.0.79 "GET /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6" status: 200 len: 1521 microversion: 2.1 time: 0.239205 Jan 28 02:07:52.375226 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 153/309] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:07:52 2022] GET /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6 => generated 1521 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:07:52.427334 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-90bdfd33-dc42-4046-a86d-64f98ac74e55 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:07:52.428140 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-90bdfd33-dc42-4046-a86d-64f98ac74e55 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] [instance: f6852bd3-1574-4ae7-a78f-16f07931687b] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:52.435724 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-90bdfd33-dc42-4046-a86d-64f98ac74e55 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:52.436217 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-90bdfd33-dc42-4046-a86d-64f98ac74e55 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:52.436995 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-90bdfd33-dc42-4046-a86d-64f98ac74e55 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:52.437430 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-90bdfd33-dc42-4046-a86d-64f98ac74e55 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:52.562153 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-90bdfd33-dc42-4046-a86d-64f98ac74e55 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b019715a14074e059730965913694e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b66ddee4c864aae90b738695dffbeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:52.569390 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-90bdfd33-dc42-4046-a86d-64f98ac74e55 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] 10.222.0.79 "GET /compute/v2.1/servers/f6852bd3-1574-4ae7-a78f-16f07931687b" status: 200 len: 1508 microversion: 2.1 time: 0.146833 Jan 28 02:07:52.569940 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 157/310] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:07:52 2022] GET /compute/v2.1/servers/f6852bd3-1574-4ae7-a78f-16f07931687b => generated 1508 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:07:52.664647 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-1941e023-aff3-4d4d-a0e0-ee1f3eded910 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:07:52.666056 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-1941e023-aff3-4d4d-a0e0-ee1f3eded910 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: d5f49055-da38-486c-9f10-1658c64d46f5] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:52.673845 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-1941e023-aff3-4d4d-a0e0-ee1f3eded910 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:52.674291 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-1941e023-aff3-4d4d-a0e0-ee1f3eded910 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:52.678650 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-1941e023-aff3-4d4d-a0e0-ee1f3eded910 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:52.678650 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-1941e023-aff3-4d4d-a0e0-ee1f3eded910 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:52.703898 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-61b826ae-ebfb-40ec-adc7-409fa11f87fa tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:07:52.705422 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-61b826ae-ebfb-40ec-adc7-409fa11f87fa tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:52.716269 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-61b826ae-ebfb-40ec-adc7-409fa11f87fa tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:52.716269 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-61b826ae-ebfb-40ec-adc7-409fa11f87fa tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:52.716269 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-61b826ae-ebfb-40ec-adc7-409fa11f87fa tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:52.716269 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-61b826ae-ebfb-40ec-adc7-409fa11f87fa tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:54.793570 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-1941e023-aff3-4d4d-a0e0-ee1f3eded910 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "POST /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5/action" status: 200 len: 28628 microversion: 2.1 time: 2.131723 Jan 28 02:07:54.793570 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 154/311] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Jan 28 02:07:52 2022] POST /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5/action => generated 28628 bytes in 2133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 02:07:54.798774 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-56420221-ad85-443f-be61-41cb21264ad5 tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:07:54.799540 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-56420221-ad85-443f-be61-41cb21264ad5 tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] [instance: a6a959a9-19ae-4499-8baf-4079dc64c783] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:54.806090 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-56420221-ad85-443f-be61-41cb21264ad5 tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:54.806538 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-56420221-ad85-443f-be61-41cb21264ad5 tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:54.807341 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-56420221-ad85-443f-be61-41cb21264ad5 tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:54.807776 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-56420221-ad85-443f-be61-41cb21264ad5 tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:54.819445 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-61b826ae-ebfb-40ec-adc7-409fa11f87fa tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "POST /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84/action" status: 200 len: 34836 microversion: 2.20 time: 2.119955 Jan 28 02:07:54.820326 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 158/312] 10.222.0.79 () {62 vars in 1318 bytes} [Fri Jan 28 02:07:52 2022] POST /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84/action => generated 34836 bytes in 2122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:07:54.826014 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-7823ebca-58a6-40ca-a1ca-d4675dd81d3f tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:07:54.826694 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-7823ebca-58a6-40ca-a1ca-d4675dd81d3f tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] [instance: ec5e47ac-761b-467f-958c-516a9f8bc3e6] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:54.833458 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-7823ebca-58a6-40ca-a1ca-d4675dd81d3f tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:54.834143 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-7823ebca-58a6-40ca-a1ca-d4675dd81d3f tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:54.834954 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-7823ebca-58a6-40ca-a1ca-d4675dd81d3f tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:54.835380 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-7823ebca-58a6-40ca-a1ca-d4675dd81d3f tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:55.008516 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-56420221-ad85-443f-be61-41cb21264ad5 tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5d9ed0db1e4efcad0dfddb7291c658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328131fd3ad64205a4928d00c2bb8c23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:55.014066 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-7823ebca-58a6-40ca-a1ca-d4675dd81d3f tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd7039b8f074a13b2030a2bb7aaff94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc19a0f9c33f47f1b504bebbb0b2c931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:55.016328 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-56420221-ad85-443f-be61-41cb21264ad5 tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] 10.222.0.79 "GET /compute/v2.1/servers/a6a959a9-19ae-4499-8baf-4079dc64c783" status: 200 len: 1315 microversion: 2.1 time: 0.222065 Jan 28 02:07:55.016893 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 155/313] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:07:54 2022] GET /compute/v2.1/servers/a6a959a9-19ae-4499-8baf-4079dc64c783 => generated 1315 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:07:55.021305 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [req-c85f2f07-45e1-4715-be8a-c10c2b01b816 req-8c16254a-a596-4f07-bb71-7d8149f0fa81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6a959a9-19ae-4499-8baf-4079dc64c783", "name": "network-vif-plugged", "status": "completed", "tag": "6a5dc122-96f8-4b70-a7b2-fd97f86dcdfc"}]} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:07:55.028295 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:07:55.028295 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: warnings.warn(msg) Jan 28 02:07:55.028616 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-7823ebca-58a6-40ca-a1ca-d4675dd81d3f tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] 10.222.0.79 "GET /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6" status: 200 len: 1521 microversion: 2.1 time: 0.205139 Jan 28 02:07:55.028616 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 159/314] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:07:54 2022] GET /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6 => generated 1521 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:07:55.030151 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-c85f2f07-45e1-4715-be8a-c10c2b01b816 req-8c16254a-a596-4f07-bb71-7d8149f0fa81 service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:55.030592 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-c85f2f07-45e1-4715-be8a-c10c2b01b816 req-8c16254a-a596-4f07-bb71-7d8149f0fa81 service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:55.041666 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.compute.server_external_events [req-c85f2f07-45e1-4715-be8a-c10c2b01b816 req-8c16254a-a596-4f07-bb71-7d8149f0fa81 service nova] Creating event network-vif-plugged:6a5dc122-96f8-4b70-a7b2-fd97f86dcdfc for instance a6a959a9-19ae-4499-8baf-4079dc64c783 on hv-cinder-82497 Jan 28 02:07:55.047226 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [req-c85f2f07-45e1-4715-be8a-c10c2b01b816 req-8c16254a-a596-4f07-bb71-7d8149f0fa81 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029234 Jan 28 02:07:55.052022 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 156/315] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Jan 28 02:07:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:07:55.804640 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-4995a7c4-8eec-4366-8b0b-c72a2e87c3dc tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:07:55.805583 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-4995a7c4-8eec-4366-8b0b-c72a2e87c3dc tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: d5f49055-da38-486c-9f10-1658c64d46f5] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:55.812777 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-4995a7c4-8eec-4366-8b0b-c72a2e87c3dc tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:55.813219 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-4995a7c4-8eec-4366-8b0b-c72a2e87c3dc tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:55.813983 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-4995a7c4-8eec-4366-8b0b-c72a2e87c3dc tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:55.814408 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-4995a7c4-8eec-4366-8b0b-c72a2e87c3dc tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:55.833626 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-db3ebbc9-b2cc-41ba-b7b7-b3ba6094a488 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:07:55.835331 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-db3ebbc9-b2cc-41ba-b7b7-b3ba6094a488 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:55.842693 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-db3ebbc9-b2cc-41ba-b7b7-b3ba6094a488 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:55.843242 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-db3ebbc9-b2cc-41ba-b7b7-b3ba6094a488 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:55.844168 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-db3ebbc9-b2cc-41ba-b7b7-b3ba6094a488 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:55.844640 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-db3ebbc9-b2cc-41ba-b7b7-b3ba6094a488 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:55.986535 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-db3ebbc9-b2cc-41ba-b7b7-b3ba6094a488 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "POST /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84/action" status: 200 len: 35799 microversion: 2.20 time: 0.157321 Jan 28 02:07:55.987961 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 157/316] 10.222.0.79 () {62 vars in 1318 bytes} [Fri Jan 28 02:07:55 2022] POST /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84/action => generated 35799 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 28 02:07:56.008340 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-4995a7c4-8eec-4366-8b0b-c72a2e87c3dc tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "POST /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5/action" status: 200 len: 28628 microversion: 2.1 time: 0.207002 Jan 28 02:07:56.008769 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 160/317] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Jan 28 02:07:55 2022] POST /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5/action => generated 28628 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 02:07:56.033584 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-b6094368-c802-4e5f-8105-c20c5280011a tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:07:56.034387 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-b6094368-c802-4e5f-8105-c20c5280011a tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] [instance: a6a959a9-19ae-4499-8baf-4079dc64c783] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:56.044929 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-ce6908ae-e9b4-400c-919c-05bc3a163e67 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:07:56.045153 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b6094368-c802-4e5f-8105-c20c5280011a tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:56.045369 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b6094368-c802-4e5f-8105-c20c5280011a tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:56.045626 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-ce6908ae-e9b4-400c-919c-05bc3a163e67 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] [instance: ec5e47ac-761b-467f-958c-516a9f8bc3e6] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:56.046162 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b6094368-c802-4e5f-8105-c20c5280011a tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:56.046623 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b6094368-c802-4e5f-8105-c20c5280011a tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:56.052231 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-ce6908ae-e9b4-400c-919c-05bc3a163e67 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:56.052673 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-ce6908ae-e9b4-400c-919c-05bc3a163e67 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:56.053464 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-ce6908ae-e9b4-400c-919c-05bc3a163e67 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:56.053928 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-ce6908ae-e9b4-400c-919c-05bc3a163e67 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:56.245445 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-ce6908ae-e9b4-400c-919c-05bc3a163e67 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd7039b8f074a13b2030a2bb7aaff94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc19a0f9c33f47f1b504bebbb0b2c931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:56.254232 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-ce6908ae-e9b4-400c-919c-05bc3a163e67 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] 10.222.0.79 "GET /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6" status: 200 len: 1521 microversion: 2.1 time: 0.213307 Jan 28 02:07:56.264529 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 161/318] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:07:56 2022] GET /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6 => generated 1521 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:07:56.264792 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-b6094368-c802-4e5f-8105-c20c5280011a tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5d9ed0db1e4efcad0dfddb7291c658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328131fd3ad64205a4928d00c2bb8c23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:07:56.268907 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-b6094368-c802-4e5f-8105-c20c5280011a tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] 10.222.0.79 "GET /compute/v2.1/servers/a6a959a9-19ae-4499-8baf-4079dc64c783" status: 200 len: 1315 microversion: 2.1 time: 0.239340 Jan 28 02:07:56.269461 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 158/319] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:07:56 2022] GET /compute/v2.1/servers/a6a959a9-19ae-4499-8baf-4079dc64c783 => generated 1315 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:07:56.562995 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-c07d2ab1-de76-4ee8-b966-19573a2d1f48 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "eb9e1d95-ba0d-465a-88ec-5bef9f42fb48"}} {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:07:56.564293 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-c07d2ab1-de76-4ee8-b966-19573a2d1f48 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] [instance: f6852bd3-1574-4ae7-a78f-16f07931687b] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:56.571328 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-c07d2ab1-de76-4ee8-b966-19573a2d1f48 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:56.571772 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-c07d2ab1-de76-4ee8-b966-19573a2d1f48 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:56.574380 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-c07d2ab1-de76-4ee8-b966-19573a2d1f48 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:56.574380 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-c07d2ab1-de76-4ee8-b966-19573a2d1f48 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:56.999800 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-09ea9d71-a84b-489c-af53-b3be892f4f09 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:07:57.000936 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-09ea9d71-a84b-489c-af53-b3be892f4f09 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:57.007129 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-09ea9d71-a84b-489c-af53-b3be892f4f09 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:57.007571 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-09ea9d71-a84b-489c-af53-b3be892f4f09 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:57.008371 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-09ea9d71-a84b-489c-af53-b3be892f4f09 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:57.008799 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-09ea9d71-a84b-489c-af53-b3be892f4f09 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:57.484107 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-c07d2ab1-de76-4ee8-b966-19573a2d1f48 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] 10.222.0.79 "POST /compute/v2.1/servers/f6852bd3-1574-4ae7-a78f-16f07931687b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.926992 Jan 28 02:07:57.489955 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 162/320] 10.222.0.79 () {60 vars in 1322 bytes} [Fri Jan 28 02:07:56 2022] POST /compute/v2.1/servers/f6852bd3-1574-4ae7-a78f-16f07931687b/os-volume_attachments => generated 194 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:07:57.490181 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-df16f560-2feb-4bfa-96d0-43a9030749a8 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:07:57.491207 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-df16f560-2feb-4bfa-96d0-43a9030749a8 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: d5f49055-da38-486c-9f10-1658c64d46f5] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:57.498590 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-df16f560-2feb-4bfa-96d0-43a9030749a8 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:57.499064 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-df16f560-2feb-4bfa-96d0-43a9030749a8 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:57.500105 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-df16f560-2feb-4bfa-96d0-43a9030749a8 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:57.500392 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-df16f560-2feb-4bfa-96d0-43a9030749a8 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:59.963704 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-df16f560-2feb-4bfa-96d0-43a9030749a8 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "POST /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5/action" status: 200 len: 28628 microversion: 2.1 time: 2.477619 Jan 28 02:07:59.968265 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 163/321] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Jan 28 02:07:57 2022] POST /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5/action => generated 28628 bytes in 2479 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 02:07:59.970016 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-cf051418-d069-4a43-86aa-4b6e16549754 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:07:59.970694 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-cf051418-d069-4a43-86aa-4b6e16549754 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] [instance: ec5e47ac-761b-467f-958c-516a9f8bc3e6] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:07:59.976956 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-cf051418-d069-4a43-86aa-4b6e16549754 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:59.977398 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-cf051418-d069-4a43-86aa-4b6e16549754 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:07:59.978157 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-cf051418-d069-4a43-86aa-4b6e16549754 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:07:59.978586 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-cf051418-d069-4a43-86aa-4b6e16549754 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:00.004055 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-09ea9d71-a84b-489c-af53-b3be892f4f09 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "POST /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84/action" status: 200 len: 38218 microversion: 2.20 time: 3.008017 Jan 28 02:08:00.005362 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 159/322] 10.222.0.79 () {62 vars in 1318 bytes} [Fri Jan 28 02:07:56 2022] POST /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84/action => generated 38218 bytes in 3011 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 28 02:08:00.015848 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-120ebed6-1ce3-4a01-b19b-1a436780a22e tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:00.022818 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-120ebed6-1ce3-4a01-b19b-1a436780a22e tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] [instance: a6a959a9-19ae-4499-8baf-4079dc64c783] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:00.024360 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-120ebed6-1ce3-4a01-b19b-1a436780a22e tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:00.024910 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-120ebed6-1ce3-4a01-b19b-1a436780a22e tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:00.025806 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-120ebed6-1ce3-4a01-b19b-1a436780a22e tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:00.026375 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-120ebed6-1ce3-4a01-b19b-1a436780a22e tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:00.176870 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-120ebed6-1ce3-4a01-b19b-1a436780a22e tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5d9ed0db1e4efcad0dfddb7291c658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328131fd3ad64205a4928d00c2bb8c23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:00.189320 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-120ebed6-1ce3-4a01-b19b-1a436780a22e tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] 10.222.0.79 "GET /compute/v2.1/servers/a6a959a9-19ae-4499-8baf-4079dc64c783" status: 200 len: 1463 microversion: 2.1 time: 0.178321 Jan 28 02:08:00.203910 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 160/323] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:08:00 2022] GET /compute/v2.1/servers/a6a959a9-19ae-4499-8baf-4079dc64c783 => generated 1463 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:08:00.257326 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-924b330c-ac84-412a-bedd-469a95233126 tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:00.259082 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-924b330c-ac84-412a-bedd-469a95233126 tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] [instance: a6a959a9-19ae-4499-8baf-4079dc64c783] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:00.266907 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-924b330c-ac84-412a-bedd-469a95233126 tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:00.267729 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-924b330c-ac84-412a-bedd-469a95233126 tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:00.268594 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-924b330c-ac84-412a-bedd-469a95233126 tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:00.269095 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-924b330c-ac84-412a-bedd-469a95233126 tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:00.282660 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-cf051418-d069-4a43-86aa-4b6e16549754 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd7039b8f074a13b2030a2bb7aaff94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc19a0f9c33f47f1b504bebbb0b2c931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:00.290175 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-cf051418-d069-4a43-86aa-4b6e16549754 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] 10.222.0.79 "GET /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6" status: 200 len: 1521 microversion: 2.1 time: 0.324532 Jan 28 02:08:00.290728 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 164/324] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:07:59 2022] GET /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6 => generated 1521 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:08:00.301431 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-924b330c-ac84-412a-bedd-469a95233126 tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] [instance: a6a959a9-19ae-4499-8baf-4079dc64c783] Going to try to terminate instance {{(pid=116375) delete /opt/stack/nova/nova/compute/api.py:2612}} Jan 28 02:08:00.645378 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-924b330c-ac84-412a-bedd-469a95233126 tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] 10.222.0.79 "DELETE /compute/v2.1/servers/a6a959a9-19ae-4499-8baf-4079dc64c783" status: 204 len: 0 microversion: 2.1 time: 0.392338 Jan 28 02:08:00.645874 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 161/325] 10.222.0.79 () {58 vars in 1238 bytes} [Fri Jan 28 02:08:00 2022] DELETE /compute/v2.1/servers/a6a959a9-19ae-4499-8baf-4079dc64c783 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 28 02:08:00.654060 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-4a143674-8b17-47eb-8441-95b18278d1c0 tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:00.654717 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-4a143674-8b17-47eb-8441-95b18278d1c0 tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] [instance: a6a959a9-19ae-4499-8baf-4079dc64c783] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:00.662948 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-4a143674-8b17-47eb-8441-95b18278d1c0 tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:00.663197 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-4a143674-8b17-47eb-8441-95b18278d1c0 tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:00.664276 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-4a143674-8b17-47eb-8441-95b18278d1c0 tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:00.664889 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-4a143674-8b17-47eb-8441-95b18278d1c0 tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:00.818756 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-4a143674-8b17-47eb-8441-95b18278d1c0 tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5d9ed0db1e4efcad0dfddb7291c658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328131fd3ad64205a4928d00c2bb8c23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:00.826196 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-4a143674-8b17-47eb-8441-95b18278d1c0 tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] 10.222.0.79 "GET /compute/v2.1/servers/a6a959a9-19ae-4499-8baf-4079dc64c783" status: 200 len: 1469 microversion: 2.1 time: 0.175862 Jan 28 02:08:00.827370 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 165/326] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:08:00 2022] GET /compute/v2.1/servers/a6a959a9-19ae-4499-8baf-4079dc64c783 => generated 1469 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:08:00.978137 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-2c56c29c-6a82-40b8-bbf7-bbea006a0a7d tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:08:00.979390 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-2c56c29c-6a82-40b8-bbf7-bbea006a0a7d tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: d5f49055-da38-486c-9f10-1658c64d46f5] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:00.985373 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2c56c29c-6a82-40b8-bbf7-bbea006a0a7d tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:00.985820 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2c56c29c-6a82-40b8-bbf7-bbea006a0a7d tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:00.986633 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2c56c29c-6a82-40b8-bbf7-bbea006a0a7d tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:00.987072 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2c56c29c-6a82-40b8-bbf7-bbea006a0a7d tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:01.017757 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-6f95a7f0-0404-4e3a-ba93-fd30314f25d3 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:08:01.018707 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-6f95a7f0-0404-4e3a-ba93-fd30314f25d3 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:01.024834 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-6f95a7f0-0404-4e3a-ba93-fd30314f25d3 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:01.027493 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-6f95a7f0-0404-4e3a-ba93-fd30314f25d3 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:01.027493 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-6f95a7f0-0404-4e3a-ba93-fd30314f25d3 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:01.027493 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-6f95a7f0-0404-4e3a-ba93-fd30314f25d3 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:01.141814 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-2c56c29c-6a82-40b8-bbf7-bbea006a0a7d tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "POST /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5/action" status: 200 len: 29677 microversion: 2.1 time: 0.168766 Jan 28 02:08:01.145979 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 162/327] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Jan 28 02:08:00 2022] POST /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5/action => generated 29677 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 02:08:01.171287 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-6f95a7f0-0404-4e3a-ba93-fd30314f25d3 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "POST /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84/action" status: 200 len: 38224 microversion: 2.20 time: 0.157455 Jan 28 02:08:01.172266 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 166/328] 10.222.0.79 () {62 vars in 1318 bytes} [Fri Jan 28 02:08:01 2022] POST /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84/action => generated 38224 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 28 02:08:01.315256 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-92361a9d-1172-49fc-a36a-d3b35ae8016e tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:01.315939 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-92361a9d-1172-49fc-a36a-d3b35ae8016e tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] [instance: ec5e47ac-761b-467f-958c-516a9f8bc3e6] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:01.323944 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-92361a9d-1172-49fc-a36a-d3b35ae8016e tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:01.324373 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-92361a9d-1172-49fc-a36a-d3b35ae8016e tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:01.325153 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-92361a9d-1172-49fc-a36a-d3b35ae8016e tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:01.325582 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-92361a9d-1172-49fc-a36a-d3b35ae8016e tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:01.451239 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-92361a9d-1172-49fc-a36a-d3b35ae8016e tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd7039b8f074a13b2030a2bb7aaff94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc19a0f9c33f47f1b504bebbb0b2c931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:01.459529 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-92361a9d-1172-49fc-a36a-d3b35ae8016e tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] 10.222.0.79 "GET /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6" status: 200 len: 1521 microversion: 2.1 time: 0.150314 Jan 28 02:08:01.461055 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 163/329] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:08:01 2022] GET /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:08:01.845104 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-c0d59ba9-4e76-4201-85c1-3171fa99062e tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:01.845890 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-c0d59ba9-4e76-4201-85c1-3171fa99062e tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] [instance: a6a959a9-19ae-4499-8baf-4079dc64c783] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:01.852268 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-c0d59ba9-4e76-4201-85c1-3171fa99062e tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:01.852707 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-c0d59ba9-4e76-4201-85c1-3171fa99062e tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:01.853475 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-c0d59ba9-4e76-4201-85c1-3171fa99062e tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:01.854044 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-c0d59ba9-4e76-4201-85c1-3171fa99062e tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:01.979570 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-c0d59ba9-4e76-4201-85c1-3171fa99062e tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5d9ed0db1e4efcad0dfddb7291c658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328131fd3ad64205a4928d00c2bb8c23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:01.989093 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-c0d59ba9-4e76-4201-85c1-3171fa99062e tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] 10.222.0.79 "GET /compute/v2.1/servers/a6a959a9-19ae-4499-8baf-4079dc64c783" status: 200 len: 1469 microversion: 2.1 time: 0.148886 Jan 28 02:08:01.989757 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 167/330] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:08:01 2022] GET /compute/v2.1/servers/a6a959a9-19ae-4499-8baf-4079dc64c783 => generated 1469 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:08:02.153899 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-474f0bc4-6cc3-413e-972c-7da39a5d7755 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:08:02.154840 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-474f0bc4-6cc3-413e-972c-7da39a5d7755 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: d5f49055-da38-486c-9f10-1658c64d46f5] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:02.160816 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-474f0bc4-6cc3-413e-972c-7da39a5d7755 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:02.161258 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-474f0bc4-6cc3-413e-972c-7da39a5d7755 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:02.162018 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-474f0bc4-6cc3-413e-972c-7da39a5d7755 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:02.162443 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-474f0bc4-6cc3-413e-972c-7da39a5d7755 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:02.183028 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-4d3a8738-b5bf-4aa6-95b6-daae3aed14d0 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:08:02.184122 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-4d3a8738-b5bf-4aa6-95b6-daae3aed14d0 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:02.191122 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-4d3a8738-b5bf-4aa6-95b6-daae3aed14d0 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:02.191574 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-4d3a8738-b5bf-4aa6-95b6-daae3aed14d0 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:02.192386 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-4d3a8738-b5bf-4aa6-95b6-daae3aed14d0 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:02.192824 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-4d3a8738-b5bf-4aa6-95b6-daae3aed14d0 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:02.321478 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-474f0bc4-6cc3-413e-972c-7da39a5d7755 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "POST /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5/action" status: 200 len: 30912 microversion: 2.1 time: 0.171125 Jan 28 02:08:02.322167 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 164/331] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Jan 28 02:08:02 2022] POST /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5/action => generated 30912 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 02:08:02.366469 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-4d3a8738-b5bf-4aa6-95b6-daae3aed14d0 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "POST /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84/action" status: 200 len: 38361 microversion: 2.20 time: 0.187155 Jan 28 02:08:02.367174 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 168/332] 10.222.0.79 () {62 vars in 1318 bytes} [Fri Jan 28 02:08:02 2022] POST /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84/action => generated 38361 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 28 02:08:02.378964 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-0343b701-195d-44bc-86c4-2d076a04f837 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:02.379599 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-0343b701-195d-44bc-86c4-2d076a04f837 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:02.386067 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-0343b701-195d-44bc-86c4-2d076a04f837 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:02.386509 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-0343b701-195d-44bc-86c4-2d076a04f837 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:02.387275 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-0343b701-195d-44bc-86c4-2d076a04f837 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:02.387705 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-0343b701-195d-44bc-86c4-2d076a04f837 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:02.411146 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-0343b701-195d-44bc-86c4-2d076a04f837 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84/ips" status: 200 len: 150 microversion: 2.20 time: 0.036280 Jan 28 02:08:02.411724 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 165/333] 10.222.0.79 () {60 vars in 1288 bytes} [Fri Jan 28 02:08:02 2022] GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84/ips => generated 150 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 02:08:02.478486 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-c41106f3-42b3-47b1-9120-6427cdb2290d tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:02.479185 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-c41106f3-42b3-47b1-9120-6427cdb2290d tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] [instance: ec5e47ac-761b-467f-958c-516a9f8bc3e6] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:02.486732 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-c41106f3-42b3-47b1-9120-6427cdb2290d tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:02.487232 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-c41106f3-42b3-47b1-9120-6427cdb2290d tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:02.487957 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-c41106f3-42b3-47b1-9120-6427cdb2290d tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:02.488408 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-c41106f3-42b3-47b1-9120-6427cdb2290d tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:02.661867 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-c41106f3-42b3-47b1-9120-6427cdb2290d tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd7039b8f074a13b2030a2bb7aaff94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc19a0f9c33f47f1b504bebbb0b2c931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:02.669581 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-c41106f3-42b3-47b1-9120-6427cdb2290d tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] 10.222.0.79 "GET /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6" status: 200 len: 1521 microversion: 2.1 time: 0.195489 Jan 28 02:08:02.670235 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 169/334] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:08:02 2022] GET /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6 => generated 1521 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:08:03.006969 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-e36e5a9c-32b1-4d32-b063-ff8bd20e82ef tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:03.007729 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-e36e5a9c-32b1-4d32-b063-ff8bd20e82ef tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] [instance: a6a959a9-19ae-4499-8baf-4079dc64c783] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:03.013551 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-e36e5a9c-32b1-4d32-b063-ff8bd20e82ef tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:03.013990 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-e36e5a9c-32b1-4d32-b063-ff8bd20e82ef tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:03.015332 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-e36e5a9c-32b1-4d32-b063-ff8bd20e82ef tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:03.015762 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-e36e5a9c-32b1-4d32-b063-ff8bd20e82ef tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:03.247825 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-e36e5a9c-32b1-4d32-b063-ff8bd20e82ef tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5d9ed0db1e4efcad0dfddb7291c658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328131fd3ad64205a4928d00c2bb8c23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:03.258054 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-e36e5a9c-32b1-4d32-b063-ff8bd20e82ef tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] 10.222.0.79 "GET /compute/v2.1/servers/a6a959a9-19ae-4499-8baf-4079dc64c783" status: 200 len: 1469 microversion: 2.1 time: 0.253369 Jan 28 02:08:03.258403 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 166/335] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:08:03 2022] GET /compute/v2.1/servers/a6a959a9-19ae-4499-8baf-4079dc64c783 => generated 1469 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:08:03.333514 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-81b76f56-36d8-4604-a8e3-49d0332805d3 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:08:03.335403 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-81b76f56-36d8-4604-a8e3-49d0332805d3 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: d5f49055-da38-486c-9f10-1658c64d46f5] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:03.342099 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-81b76f56-36d8-4604-a8e3-49d0332805d3 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:03.343187 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-81b76f56-36d8-4604-a8e3-49d0332805d3 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:03.344037 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-81b76f56-36d8-4604-a8e3-49d0332805d3 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:03.344945 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-81b76f56-36d8-4604-a8e3-49d0332805d3 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:03.465992 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-81b76f56-36d8-4604-a8e3-49d0332805d3 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "POST /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5/action" status: 200 len: 32010 microversion: 2.1 time: 0.135907 Jan 28 02:08:03.468210 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 170/336] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Jan 28 02:08:03 2022] POST /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5/action => generated 32010 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 02:08:03.645599 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [req-23fdb583-86a9-424d-9257-6ce480c4a018 req-e2cf66dc-d27d-485f-a7ae-0819c7b31764 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6a959a9-19ae-4499-8baf-4079dc64c783", "name": "network-vif-deleted", "tag": "6a5dc122-96f8-4b70-a7b2-fd97f86dcdfc"}]} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:08:03.651357 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:08:03.651357 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: warnings.warn(msg) Jan 28 02:08:03.656713 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-23fdb583-86a9-424d-9257-6ce480c4a018 req-e2cf66dc-d27d-485f-a7ae-0819c7b31764 service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:03.657277 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-23fdb583-86a9-424d-9257-6ce480c4a018 req-e2cf66dc-d27d-485f-a7ae-0819c7b31764 service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:03.669359 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.compute.server_external_events [req-23fdb583-86a9-424d-9257-6ce480c4a018 req-e2cf66dc-d27d-485f-a7ae-0819c7b31764 service nova] Creating event network-vif-deleted:6a5dc122-96f8-4b70-a7b2-fd97f86dcdfc for instance a6a959a9-19ae-4499-8baf-4079dc64c783 on hv-cinder-82497 Jan 28 02:08:03.675446 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [req-23fdb583-86a9-424d-9257-6ce480c4a018 req-e2cf66dc-d27d-485f-a7ae-0819c7b31764 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033843 Jan 28 02:08:03.676468 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 167/337] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Jan 28 02:08:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:08:03.687361 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-75f3a8af-8bc7-4e08-b019-ba2b40d6e3b5 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:03.688113 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-75f3a8af-8bc7-4e08-b019-ba2b40d6e3b5 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] [instance: ec5e47ac-761b-467f-958c-516a9f8bc3e6] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:03.694993 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-75f3a8af-8bc7-4e08-b019-ba2b40d6e3b5 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:03.695437 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-75f3a8af-8bc7-4e08-b019-ba2b40d6e3b5 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:03.696571 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-75f3a8af-8bc7-4e08-b019-ba2b40d6e3b5 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:03.697011 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-75f3a8af-8bc7-4e08-b019-ba2b40d6e3b5 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:03.837838 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-75f3a8af-8bc7-4e08-b019-ba2b40d6e3b5 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd7039b8f074a13b2030a2bb7aaff94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc19a0f9c33f47f1b504bebbb0b2c931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:03.859382 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-75f3a8af-8bc7-4e08-b019-ba2b40d6e3b5 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] 10.222.0.79 "GET /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6" status: 200 len: 1521 microversion: 2.1 time: 0.176146 Jan 28 02:08:03.859874 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 171/338] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:08:03 2022] GET /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6 => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:08:04.277347 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-325fbcd4-e7d4-4ca2-8ce4-347eabb98959 tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:04.278197 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-325fbcd4-e7d4-4ca2-8ce4-347eabb98959 tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] [instance: a6a959a9-19ae-4499-8baf-4079dc64c783] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:04.286532 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-325fbcd4-e7d4-4ca2-8ce4-347eabb98959 tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:04.287512 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-325fbcd4-e7d4-4ca2-8ce4-347eabb98959 tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:04.288423 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-325fbcd4-e7d4-4ca2-8ce4-347eabb98959 tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:04.289087 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-325fbcd4-e7d4-4ca2-8ce4-347eabb98959 tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:04.330225 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-325fbcd4-e7d4-4ca2-8ce4-347eabb98959 tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:04.330225 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-325fbcd4-e7d4-4ca2-8ce4-347eabb98959 tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:04.330225 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.objects.instance [None req-325fbcd4-e7d4-4ca2-8ce4-347eabb98959 tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] Lazy-loading 'fault' on Instance uuid a6a959a9-19ae-4499-8baf-4079dc64c783 {{(pid=116375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jan 28 02:08:04.372423 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-325fbcd4-e7d4-4ca2-8ce4-347eabb98959 tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5d9ed0db1e4efcad0dfddb7291c658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328131fd3ad64205a4928d00c2bb8c23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:04.380349 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-325fbcd4-e7d4-4ca2-8ce4-347eabb98959 tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] 10.222.0.79 "GET /compute/v2.1/servers/a6a959a9-19ae-4499-8baf-4079dc64c783" status: 200 len: 1305 microversion: 2.1 time: 0.110239 Jan 28 02:08:04.380924 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 168/339] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:08:04 2022] GET /compute/v2.1/servers/a6a959a9-19ae-4499-8baf-4079dc64c783 => generated 1305 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:08:04.478359 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-a43be939-96b7-4e7e-899b-ae93f54f05a6 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:08:04.479264 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-a43be939-96b7-4e7e-899b-ae93f54f05a6 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: d5f49055-da38-486c-9f10-1658c64d46f5] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:04.485914 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-a43be939-96b7-4e7e-899b-ae93f54f05a6 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:04.486393 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-a43be939-96b7-4e7e-899b-ae93f54f05a6 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:04.487163 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-a43be939-96b7-4e7e-899b-ae93f54f05a6 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:04.487590 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-a43be939-96b7-4e7e-899b-ae93f54f05a6 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:04.610408 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-a43be939-96b7-4e7e-899b-ae93f54f05a6 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "POST /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5/action" status: 200 len: 32699 microversion: 2.1 time: 0.135711 Jan 28 02:08:04.611042 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 172/340] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Jan 28 02:08:04 2022] POST /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5/action => generated 32699 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 02:08:04.876316 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-684e326b-ed4e-4ef8-a7f2-93e8fe2db863 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:04.880669 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-684e326b-ed4e-4ef8-a7f2-93e8fe2db863 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] [instance: ec5e47ac-761b-467f-958c-516a9f8bc3e6] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:04.882891 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-684e326b-ed4e-4ef8-a7f2-93e8fe2db863 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:04.883344 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-684e326b-ed4e-4ef8-a7f2-93e8fe2db863 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:04.884214 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-684e326b-ed4e-4ef8-a7f2-93e8fe2db863 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:04.884648 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-684e326b-ed4e-4ef8-a7f2-93e8fe2db863 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:05.007354 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-684e326b-ed4e-4ef8-a7f2-93e8fe2db863 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd7039b8f074a13b2030a2bb7aaff94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc19a0f9c33f47f1b504bebbb0b2c931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:05.014948 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-684e326b-ed4e-4ef8-a7f2-93e8fe2db863 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] 10.222.0.79 "GET /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6" status: 200 len: 1521 microversion: 2.1 time: 0.142596 Jan 28 02:08:05.015639 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 169/341] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:08:04 2022] GET /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6 => generated 1521 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:08:05.303472 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-73b54d99-7a4a-40db-8af4-a53a0cd8f670 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:08:05.304101 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-73b54d99-7a4a-40db-8af4-a53a0cd8f670 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:05.314746 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-73b54d99-7a4a-40db-8af4-a53a0cd8f670 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:05.315307 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-73b54d99-7a4a-40db-8af4-a53a0cd8f670 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:05.316211 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-73b54d99-7a4a-40db-8af4-a53a0cd8f670 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:05.316708 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-73b54d99-7a4a-40db-8af4-a53a0cd8f670 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:05.361621 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.objects.instance [None req-73b54d99-7a4a-40db-8af4-a53a0cd8f670 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lazy-loading 'flavor' on Instance uuid 4f25403b-0399-48d0-86a9-6e5022287c84 {{(pid=116374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jan 28 02:08:05.397950 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-21cc0cbf-5493-4402-b2e8-acaa59c27787 tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:05.398526 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-21cc0cbf-5493-4402-b2e8-acaa59c27787 tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] [instance: a6a959a9-19ae-4499-8baf-4079dc64c783] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:05.404451 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-21cc0cbf-5493-4402-b2e8-acaa59c27787 tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:05.405643 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-21cc0cbf-5493-4402-b2e8-acaa59c27787 tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:05.406407 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-21cc0cbf-5493-4402-b2e8-acaa59c27787 tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:05.406825 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-21cc0cbf-5493-4402-b2e8-acaa59c27787 tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:05.421112 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.wsgi [None req-21cc0cbf-5493-4402-b2e8-acaa59c27787 tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] HTTP exception thrown: Instance a6a959a9-19ae-4499-8baf-4079dc64c783 could not be found. Jan 28 02:08:05.421790 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-21cc0cbf-5493-4402-b2e8-acaa59c27787 tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] Returning 404 to user: Instance a6a959a9-19ae-4499-8baf-4079dc64c783 could not be found. {{(pid=116375) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 02:08:05.422608 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-21cc0cbf-5493-4402-b2e8-acaa59c27787 tempest-VolumesNegativeTest-1513153565 tempest-VolumesNegativeTest-1513153565-project] 10.222.0.79 "GET /compute/v2.1/servers/a6a959a9-19ae-4499-8baf-4079dc64c783" status: 404 len: 111 microversion: 2.1 time: 0.028800 Jan 28 02:08:05.423165 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 170/342] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:08:05 2022] GET /compute/v2.1/servers/a6a959a9-19ae-4499-8baf-4079dc64c783 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 28 02:08:05.627532 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-1e45df82-0c2f-486f-b087-9a18c37eb163 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:08:05.629360 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-1e45df82-0c2f-486f-b087-9a18c37eb163 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: d5f49055-da38-486c-9f10-1658c64d46f5] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:05.637089 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-1e45df82-0c2f-486f-b087-9a18c37eb163 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:05.637657 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-1e45df82-0c2f-486f-b087-9a18c37eb163 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:05.638562 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-1e45df82-0c2f-486f-b087-9a18c37eb163 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:05.639170 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-1e45df82-0c2f-486f-b087-9a18c37eb163 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:05.855072 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-1e45df82-0c2f-486f-b087-9a18c37eb163 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "POST /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5/action" status: 200 len: 33274 microversion: 2.1 time: 0.235730 Jan 28 02:08:05.855767 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 171/343] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Jan 28 02:08:05 2022] POST /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5/action => generated 33274 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 02:08:06.032341 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-404a6f04-2d5e-4fbf-8676-b79dc1dfbf51 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:06.033056 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-404a6f04-2d5e-4fbf-8676-b79dc1dfbf51 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] [instance: ec5e47ac-761b-467f-958c-516a9f8bc3e6] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:06.039421 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-404a6f04-2d5e-4fbf-8676-b79dc1dfbf51 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:06.039861 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-404a6f04-2d5e-4fbf-8676-b79dc1dfbf51 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:06.040713 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-404a6f04-2d5e-4fbf-8676-b79dc1dfbf51 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:06.041139 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-404a6f04-2d5e-4fbf-8676-b79dc1dfbf51 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:06.065415 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-73b54d99-7a4a-40db-8af4-a53a0cd8f670 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "POST /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84/action" status: 202 len: 0 microversion: 2.20 time: 0.767039 Jan 28 02:08:06.066083 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 173/344] 10.222.0.79 () {62 vars in 1318 bytes} [Fri Jan 28 02:08:05 2022] POST /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84/action => generated 0 bytes in 769 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 28 02:08:06.075919 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-494a1451-5a59-46e9-9b64-d8a978b442c2 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:06.078212 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-494a1451-5a59-46e9-9b64-d8a978b442c2 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:06.087740 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-494a1451-5a59-46e9-9b64-d8a978b442c2 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:06.087740 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-494a1451-5a59-46e9-9b64-d8a978b442c2 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:06.088129 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-494a1451-5a59-46e9-9b64-d8a978b442c2 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:06.088582 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-494a1451-5a59-46e9-9b64-d8a978b442c2 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:06.228536 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-404a6f04-2d5e-4fbf-8676-b79dc1dfbf51 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd7039b8f074a13b2030a2bb7aaff94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc19a0f9c33f47f1b504bebbb0b2c931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:06.236266 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-404a6f04-2d5e-4fbf-8676-b79dc1dfbf51 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] 10.222.0.79 "GET /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6" status: 200 len: 1521 microversion: 2.1 time: 0.207998 Jan 28 02:08:06.236900 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 172/345] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:08:06 2022] GET /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6 => generated 1521 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:08:06.275812 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-494a1451-5a59-46e9-9b64-d8a978b442c2 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:06.284204 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-494a1451-5a59-46e9-9b64-d8a978b442c2 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:06.285688 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-494a1451-5a59-46e9-9b64-d8a978b442c2 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:06.286895 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-494a1451-5a59-46e9-9b64-d8a978b442c2 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84" status: 200 len: 1723 microversion: 2.20 time: 0.216287 Jan 28 02:08:06.287436 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 174/346] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:08:06 2022] GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84 => generated 1723 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 02:08:06.866455 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-28318042-524c-4ccb-baaa-e037bbda7919 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:08:06.867462 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-28318042-524c-4ccb-baaa-e037bbda7919 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: d5f49055-da38-486c-9f10-1658c64d46f5] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:06.873246 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-28318042-524c-4ccb-baaa-e037bbda7919 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:06.874799 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-28318042-524c-4ccb-baaa-e037bbda7919 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:06.875716 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-28318042-524c-4ccb-baaa-e037bbda7919 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:06.876170 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-28318042-524c-4ccb-baaa-e037bbda7919 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:07.254230 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-76b3e68f-6372-4965-94d7-26d05d21bb77 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:07.254827 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-76b3e68f-6372-4965-94d7-26d05d21bb77 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] [instance: ec5e47ac-761b-467f-958c-516a9f8bc3e6] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:07.261317 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-76b3e68f-6372-4965-94d7-26d05d21bb77 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:07.261756 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-76b3e68f-6372-4965-94d7-26d05d21bb77 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:07.262576 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-76b3e68f-6372-4965-94d7-26d05d21bb77 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:07.263001 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-76b3e68f-6372-4965-94d7-26d05d21bb77 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:07.400602 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-76b3e68f-6372-4965-94d7-26d05d21bb77 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd7039b8f074a13b2030a2bb7aaff94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc19a0f9c33f47f1b504bebbb0b2c931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:07.408956 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-76b3e68f-6372-4965-94d7-26d05d21bb77 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] 10.222.0.79 "GET /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6" status: 200 len: 1521 microversion: 2.1 time: 0.158627 Jan 28 02:08:07.415832 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 175/347] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:08:07 2022] GET /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:08:07.415832 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-e9dd8b21-00b6-44b5-8163-374ce3d95ee1 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:07.415832 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-e9dd8b21-00b6-44b5-8163-374ce3d95ee1 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:07.420440 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-e9dd8b21-00b6-44b5-8163-374ce3d95ee1 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:07.421575 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-e9dd8b21-00b6-44b5-8163-374ce3d95ee1 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:07.422344 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-e9dd8b21-00b6-44b5-8163-374ce3d95ee1 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:07.422796 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-e9dd8b21-00b6-44b5-8163-374ce3d95ee1 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:07.547264 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-e9dd8b21-00b6-44b5-8163-374ce3d95ee1 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:07.554926 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-e9dd8b21-00b6-44b5-8163-374ce3d95ee1 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:07.556443 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-e9dd8b21-00b6-44b5-8163-374ce3d95ee1 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:07.557616 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-e9dd8b21-00b6-44b5-8163-374ce3d95ee1 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84" status: 200 len: 1723 microversion: 2.20 time: 0.147183 Jan 28 02:08:07.558165 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 176/348] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:08:07 2022] GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84 => generated 1723 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:08:08.425818 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-69f6a217-62b6-4945-9a86-1da7fb4f51e0 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:08.426630 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-69f6a217-62b6-4945-9a86-1da7fb4f51e0 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] [instance: ec5e47ac-761b-467f-958c-516a9f8bc3e6] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:08.432074 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-69f6a217-62b6-4945-9a86-1da7fb4f51e0 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:08.432518 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-69f6a217-62b6-4945-9a86-1da7fb4f51e0 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:08.433406 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-69f6a217-62b6-4945-9a86-1da7fb4f51e0 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:08.433734 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-69f6a217-62b6-4945-9a86-1da7fb4f51e0 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:08.565717 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-69f6a217-62b6-4945-9a86-1da7fb4f51e0 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd7039b8f074a13b2030a2bb7aaff94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc19a0f9c33f47f1b504bebbb0b2c931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:08.572823 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-69f6a217-62b6-4945-9a86-1da7fb4f51e0 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] 10.222.0.79 "GET /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6" status: 200 len: 1521 microversion: 2.1 time: 0.150627 Jan 28 02:08:08.573386 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 177/349] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:08:08 2022] GET /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:08:08.577834 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-a59f852f-4a95-4548-988b-5975a3d834f1 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:08.578440 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-a59f852f-4a95-4548-988b-5975a3d834f1 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:08.583947 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-a59f852f-4a95-4548-988b-5975a3d834f1 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:08.584438 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-a59f852f-4a95-4548-988b-5975a3d834f1 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:08.585207 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-a59f852f-4a95-4548-988b-5975a3d834f1 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:08.585640 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-a59f852f-4a95-4548-988b-5975a3d834f1 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:08.709482 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-a59f852f-4a95-4548-988b-5975a3d834f1 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:08.717429 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-a59f852f-4a95-4548-988b-5975a3d834f1 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:08.719668 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-a59f852f-4a95-4548-988b-5975a3d834f1 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:08.720838 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-a59f852f-4a95-4548-988b-5975a3d834f1 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84" status: 200 len: 1723 microversion: 2.20 time: 0.146549 Jan 28 02:08:08.721388 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 178/350] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:08:08 2022] GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84 => generated 1723 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:08:09.016499 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-28318042-524c-4ccb-baaa-e037bbda7919 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "POST /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5/action" status: 200 len: 35868 microversion: 2.1 time: 2.152832 Jan 28 02:08:09.018273 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 173/351] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Jan 28 02:08:06 2022] POST /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5/action => generated 35868 bytes in 2155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 02:08:09.588842 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-8b9cccaf-1f4c-40f4-9a39-6286d30becbe tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:09.589443 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-8b9cccaf-1f4c-40f4-9a39-6286d30becbe tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] [instance: ec5e47ac-761b-467f-958c-516a9f8bc3e6] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:09.596927 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-8b9cccaf-1f4c-40f4-9a39-6286d30becbe tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:09.597375 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-8b9cccaf-1f4c-40f4-9a39-6286d30becbe tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:09.598139 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-8b9cccaf-1f4c-40f4-9a39-6286d30becbe tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:09.605336 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-8b9cccaf-1f4c-40f4-9a39-6286d30becbe tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:09.727615 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-8b9cccaf-1f4c-40f4-9a39-6286d30becbe tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd7039b8f074a13b2030a2bb7aaff94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc19a0f9c33f47f1b504bebbb0b2c931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:09.736082 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-8b9cccaf-1f4c-40f4-9a39-6286d30becbe tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] 10.222.0.79 "GET /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6" status: 200 len: 1521 microversion: 2.1 time: 0.150754 Jan 28 02:08:09.736871 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 179/352] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:08:09 2022] GET /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:08:09.740557 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-c5cdeee8-49dc-4691-bb8e-319866f68cde tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:09.741321 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-c5cdeee8-49dc-4691-bb8e-319866f68cde tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:09.747917 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c5cdeee8-49dc-4691-bb8e-319866f68cde tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:09.748394 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c5cdeee8-49dc-4691-bb8e-319866f68cde tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:09.749897 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c5cdeee8-49dc-4691-bb8e-319866f68cde tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:09.750796 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c5cdeee8-49dc-4691-bb8e-319866f68cde tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:09.883452 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-c5cdeee8-49dc-4691-bb8e-319866f68cde tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:09.892709 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-c5cdeee8-49dc-4691-bb8e-319866f68cde tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:09.894335 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-c5cdeee8-49dc-4691-bb8e-319866f68cde tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:09.895500 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-c5cdeee8-49dc-4691-bb8e-319866f68cde tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84" status: 200 len: 1723 microversion: 2.20 time: 0.160021 Jan 28 02:08:09.896166 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 174/353] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:08:09 2022] GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 02:08:10.029004 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-cf0aa9ef-d033-48d5-8b09-8253d8dbd189 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:08:10.030332 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-cf0aa9ef-d033-48d5-8b09-8253d8dbd189 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: d5f49055-da38-486c-9f10-1658c64d46f5] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:10.037784 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-cf0aa9ef-d033-48d5-8b09-8253d8dbd189 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:10.038436 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-cf0aa9ef-d033-48d5-8b09-8253d8dbd189 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:10.039600 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-cf0aa9ef-d033-48d5-8b09-8253d8dbd189 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:10.040554 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-cf0aa9ef-d033-48d5-8b09-8253d8dbd189 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:10.431634 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-cf0aa9ef-d033-48d5-8b09-8253d8dbd189 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "POST /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5/action" status: 200 len: 36910 microversion: 2.1 time: 0.406099 Jan 28 02:08:10.432454 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 180/354] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Jan 28 02:08:10 2022] POST /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5/action => generated 36910 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 02:08:10.756866 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-16f989f2-b82e-4e7b-b27d-16a21c994b11 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:10.757330 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-16f989f2-b82e-4e7b-b27d-16a21c994b11 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] [instance: ec5e47ac-761b-467f-958c-516a9f8bc3e6] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:10.796852 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-16f989f2-b82e-4e7b-b27d-16a21c994b11 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:10.797699 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-16f989f2-b82e-4e7b-b27d-16a21c994b11 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:10.798408 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-16f989f2-b82e-4e7b-b27d-16a21c994b11 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:10.798842 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-16f989f2-b82e-4e7b-b27d-16a21c994b11 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:10.916185 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-f4dedf12-b623-4a9d-9fcb-1619e17c7672 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:10.916891 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-f4dedf12-b623-4a9d-9fcb-1619e17c7672 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:10.924057 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-f4dedf12-b623-4a9d-9fcb-1619e17c7672 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:10.924517 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-f4dedf12-b623-4a9d-9fcb-1619e17c7672 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:10.925272 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-f4dedf12-b623-4a9d-9fcb-1619e17c7672 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:10.925703 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-f4dedf12-b623-4a9d-9fcb-1619e17c7672 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:10.935950 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-16f989f2-b82e-4e7b-b27d-16a21c994b11 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd7039b8f074a13b2030a2bb7aaff94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc19a0f9c33f47f1b504bebbb0b2c931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:10.944863 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-16f989f2-b82e-4e7b-b27d-16a21c994b11 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] 10.222.0.79 "GET /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6" status: 200 len: 1521 microversion: 2.1 time: 0.195708 Jan 28 02:08:10.945438 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 175/355] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:08:10 2022] GET /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6 => generated 1521 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:08:11.059550 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-f4dedf12-b623-4a9d-9fcb-1619e17c7672 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:11.068689 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-f4dedf12-b623-4a9d-9fcb-1619e17c7672 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:11.070195 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-f4dedf12-b623-4a9d-9fcb-1619e17c7672 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:11.071667 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-f4dedf12-b623-4a9d-9fcb-1619e17c7672 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84" status: 200 len: 1723 microversion: 2.20 time: 0.160250 Jan 28 02:08:11.072255 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 181/356] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:08:10 2022] GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:08:11.443351 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-447c6cb3-ab4c-4bad-b6ec-7f757f3f1228 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:08:11.444375 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-447c6cb3-ab4c-4bad-b6ec-7f757f3f1228 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: d5f49055-da38-486c-9f10-1658c64d46f5] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:11.449994 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-447c6cb3-ab4c-4bad-b6ec-7f757f3f1228 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:11.450444 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-447c6cb3-ab4c-4bad-b6ec-7f757f3f1228 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:11.451184 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-447c6cb3-ab4c-4bad-b6ec-7f757f3f1228 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:11.451611 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-447c6cb3-ab4c-4bad-b6ec-7f757f3f1228 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:11.581654 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-447c6cb3-ab4c-4bad-b6ec-7f757f3f1228 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "POST /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5/action" status: 200 len: 37687 microversion: 2.1 time: 0.142033 Jan 28 02:08:11.582294 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 176/357] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Jan 28 02:08:11 2022] POST /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5/action => generated 37687 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 02:08:11.729849 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-9e1874db-7cb5-40dc-8653-4a448214e844 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1771317593", "imageRef": "04805ce8-b0a0-41b2-b614-bfb5b752cc5d", "flavorRef": "452", "networks": [{"uuid": "a1afa762-f2ce-40be-8faa-e9c2b4144812"}]}} {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:08:11.783920 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.network.neutron [None req-9e1874db-7cb5-40dc-8653-4a448214e844 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] validate_networks() for [('a1afa762-f2ce-40be-8faa-e9c2b4144812', None, None, None, None, None)] {{(pid=116374) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Jan 28 02:08:11.962856 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-abbad54f-dd6d-4bd1-acbf-c9e724be388d tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:11.963551 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-abbad54f-dd6d-4bd1-acbf-c9e724be388d tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] [instance: ec5e47ac-761b-467f-958c-516a9f8bc3e6] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:11.970987 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-abbad54f-dd6d-4bd1-acbf-c9e724be388d tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:11.971439 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-abbad54f-dd6d-4bd1-acbf-c9e724be388d tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:11.972238 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-abbad54f-dd6d-4bd1-acbf-c9e724be388d tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:11.972675 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-abbad54f-dd6d-4bd1-acbf-c9e724be388d tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:12.173305 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-abbad54f-dd6d-4bd1-acbf-c9e724be388d tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd7039b8f074a13b2030a2bb7aaff94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc19a0f9c33f47f1b504bebbb0b2c931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:12.180655 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-abbad54f-dd6d-4bd1-acbf-c9e724be388d tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] 10.222.0.79 "GET /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6" status: 200 len: 1501 microversion: 2.1 time: 0.221721 Jan 28 02:08:12.181224 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 177/358] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:08:11 2022] GET /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6 => generated 1501 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:08:12.185549 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-26737e7d-18e6-4432-ba09-9b07d3cfb3f2 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:12.186329 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-26737e7d-18e6-4432-ba09-9b07d3cfb3f2 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:12.193161 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-26737e7d-18e6-4432-ba09-9b07d3cfb3f2 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:12.193603 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-26737e7d-18e6-4432-ba09-9b07d3cfb3f2 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:12.194377 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-26737e7d-18e6-4432-ba09-9b07d3cfb3f2 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:12.194827 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-26737e7d-18e6-4432-ba09-9b07d3cfb3f2 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:12.204842 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.virt.hardware [None req-9e1874db-7cb5-40dc-8653-4a448214e844 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Flavor limits 0:0:0 {{(pid=116374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 02:08:12.205304 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.virt.hardware [None req-9e1874db-7cb5-40dc-8653-4a448214e844 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Image limits 0:0:0 {{(pid=116374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 02:08:12.205710 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.virt.hardware [None req-9e1874db-7cb5-40dc-8653-4a448214e844 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Flavor pref 0:0:0 {{(pid=116374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 02:08:12.206476 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.virt.hardware [None req-9e1874db-7cb5-40dc-8653-4a448214e844 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Image pref 0:0:0 {{(pid=116374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 02:08:12.206728 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.virt.hardware [None req-9e1874db-7cb5-40dc-8653-4a448214e844 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 02:08:12.216391 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-9e1874db-7cb5-40dc-8653-4a448214e844 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:12.216833 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-9e1874db-7cb5-40dc-8653-4a448214e844 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:12.217974 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-9e1874db-7cb5-40dc-8653-4a448214e844 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:12.218403 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-9e1874db-7cb5-40dc-8653-4a448214e844 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:12.235057 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.quota [None req-9e1874db-7cb5-40dc-8653-4a448214e844 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Getting quotas for project 2b66ddee4c864aae90b738695dffbeb9. Resources: {'ram', 'cores', 'instances'} {{(pid=116374) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 02:08:12.239013 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.quota [None req-9e1874db-7cb5-40dc-8653-4a448214e844 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Getting quotas for user b019715a14074e059730965913694e52 and project 2b66ddee4c864aae90b738695dffbeb9. Resources: {'ram', 'cores', 'instances'} {{(pid=116374) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 02:08:12.250561 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-9e1874db-7cb5-40dc-8653-4a448214e844 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Going to run 1 instances... {{(pid=116374) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 02:08:12.252905 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-9e1874db-7cb5-40dc-8653-4a448214e844 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] [instance: f529663e-c976-44f4-b501-5c3469c86721] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='04805ce8-b0a0-41b2-b614-bfb5b752cc5d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116374) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 02:08:12.322999 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-26737e7d-18e6-4432-ba09-9b07d3cfb3f2 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:12.331675 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-26737e7d-18e6-4432-ba09-9b07d3cfb3f2 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:12.333208 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-26737e7d-18e6-4432-ba09-9b07d3cfb3f2 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:12.334536 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-26737e7d-18e6-4432-ba09-9b07d3cfb3f2 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84" status: 200 len: 1723 microversion: 2.20 time: 0.152228 Jan 28 02:08:12.335034 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 178/359] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:08:12 2022] GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:08:12.339599 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-076e2ca3-8312-4d21-953a-0c9936f7b8f3 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8076368e-d03e-4596-94d8-29c048d94c79"}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:08:12.340561 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-076e2ca3-8312-4d21-953a-0c9936f7b8f3 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] [instance: ec5e47ac-761b-467f-958c-516a9f8bc3e6] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:12.347370 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-076e2ca3-8312-4d21-953a-0c9936f7b8f3 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:12.347812 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-076e2ca3-8312-4d21-953a-0c9936f7b8f3 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:12.348607 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-076e2ca3-8312-4d21-953a-0c9936f7b8f3 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:12.349029 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-076e2ca3-8312-4d21-953a-0c9936f7b8f3 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:12.371021 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-9e1874db-7cb5-40dc-8653-4a448214e844 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.644864 Jan 28 02:08:12.371825 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 182/360] 10.222.0.79 () {60 vars in 1146 bytes} [Fri Jan 28 02:08:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 646 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 28 02:08:12.373660 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.wsgi [None req-076e2ca3-8312-4d21-953a-0c9936f7b8f3 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] HTTP exception thrown: Cannot 'attach_volume' instance ec5e47ac-761b-467f-958c-516a9f8bc3e6 while it is in vm_state rescued Jan 28 02:08:12.375051 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-076e2ca3-8312-4d21-953a-0c9936f7b8f3 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Returning 409 to user: Cannot 'attach_volume' instance ec5e47ac-761b-467f-958c-516a9f8bc3e6 while it is in vm_state rescued {{(pid=116375) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 02:08:12.376131 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-076e2ca3-8312-4d21-953a-0c9936f7b8f3 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] 10.222.0.79 "POST /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.040058 Jan 28 02:08:12.376915 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 179/361] 10.222.0.79 () {60 vars in 1322 bytes} [Fri Jan 28 02:08:12 2022] POST /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6/os-volume_attachments => generated 152 bytes in 41 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jan 28 02:08:12.382364 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-2a9062a0-9dc7-4fff-bfc2-91bb6337eaa3 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:12.382980 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-2a9062a0-9dc7-4fff-bfc2-91bb6337eaa3 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] [instance: f529663e-c976-44f4-b501-5c3469c86721] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:12.385248 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-0c98f53c-085e-42f1-837e-55810cc2845d tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:08:12.385813 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-0c98f53c-085e-42f1-837e-55810cc2845d tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] [instance: ec5e47ac-761b-467f-958c-516a9f8bc3e6] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:12.398099 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-0c98f53c-085e-42f1-837e-55810cc2845d tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:12.398538 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-0c98f53c-085e-42f1-837e-55810cc2845d tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:12.399634 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-0c98f53c-085e-42f1-837e-55810cc2845d tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:12.400279 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-0c98f53c-085e-42f1-837e-55810cc2845d tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:12.437368 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-2a9062a0-9dc7-4fff-bfc2-91bb6337eaa3 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b019715a14074e059730965913694e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b66ddee4c864aae90b738695dffbeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:12.444987 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-2a9062a0-9dc7-4fff-bfc2-91bb6337eaa3 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] 10.222.0.79 "GET /compute/v2.1/servers/f529663e-c976-44f4-b501-5c3469c86721" status: 200 len: 1218 microversion: 2.1 time: 0.066599 Jan 28 02:08:12.445541 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 183/362] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:08:12 2022] GET /compute/v2.1/servers/f529663e-c976-44f4-b501-5c3469c86721 => generated 1218 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:08:12.593805 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-195d3883-06fb-41e2-a7fb-24d5322718d1 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:08:12.594677 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-195d3883-06fb-41e2-a7fb-24d5322718d1 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: d5f49055-da38-486c-9f10-1658c64d46f5] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:12.600551 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-195d3883-06fb-41e2-a7fb-24d5322718d1 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:12.600993 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-195d3883-06fb-41e2-a7fb-24d5322718d1 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:12.601748 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-195d3883-06fb-41e2-a7fb-24d5322718d1 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:12.602176 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-195d3883-06fb-41e2-a7fb-24d5322718d1 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:12.619218 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-0c98f53c-085e-42f1-837e-55810cc2845d tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] 10.222.0.79 "POST /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6/action" status: 202 len: 0 microversion: 2.1 time: 0.237756 Jan 28 02:08:12.622893 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 180/363] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Jan 28 02:08:12 2022] POST /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6/action => generated 0 bytes in 242 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 28 02:08:12.638211 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-e7c391f3-3e7b-472b-8d45-4e67769e7de6 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:12.638916 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-e7c391f3-3e7b-472b-8d45-4e67769e7de6 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] [instance: ec5e47ac-761b-467f-958c-516a9f8bc3e6] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:12.645404 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-e7c391f3-3e7b-472b-8d45-4e67769e7de6 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:12.645849 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-e7c391f3-3e7b-472b-8d45-4e67769e7de6 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:12.646619 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-e7c391f3-3e7b-472b-8d45-4e67769e7de6 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:12.647049 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-e7c391f3-3e7b-472b-8d45-4e67769e7de6 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:12.774000 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-e7c391f3-3e7b-472b-8d45-4e67769e7de6 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd7039b8f074a13b2030a2bb7aaff94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc19a0f9c33f47f1b504bebbb0b2c931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:12.781969 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-e7c391f3-3e7b-472b-8d45-4e67769e7de6 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] 10.222.0.79 "GET /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6" status: 200 len: 1509 microversion: 2.1 time: 0.157416 Jan 28 02:08:12.782544 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 181/364] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:08:12 2022] GET /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6 => generated 1509 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:08:13.354242 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-aa15e74f-89a1-4916-9572-0c099087d041 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:13.354948 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-aa15e74f-89a1-4916-9572-0c099087d041 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:13.362024 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-aa15e74f-89a1-4916-9572-0c099087d041 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:13.362409 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-aa15e74f-89a1-4916-9572-0c099087d041 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:13.363196 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-aa15e74f-89a1-4916-9572-0c099087d041 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:13.363600 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-aa15e74f-89a1-4916-9572-0c099087d041 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:13.481807 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-aa15e74f-89a1-4916-9572-0c099087d041 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:13.492223 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-aa15e74f-89a1-4916-9572-0c099087d041 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:13.493751 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-aa15e74f-89a1-4916-9572-0c099087d041 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:13.494885 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-aa15e74f-89a1-4916-9572-0c099087d041 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84" status: 200 len: 1723 microversion: 2.20 time: 0.144401 Jan 28 02:08:13.495540 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 182/365] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:08:13 2022] GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84 => generated 1723 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 02:08:13.500710 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-4f16edfc-4fb6-46ff-9f5d-9155090a1364 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:13.501307 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-4f16edfc-4fb6-46ff-9f5d-9155090a1364 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] [instance: f529663e-c976-44f4-b501-5c3469c86721] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:13.506983 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-4f16edfc-4fb6-46ff-9f5d-9155090a1364 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:13.507421 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-4f16edfc-4fb6-46ff-9f5d-9155090a1364 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:13.508205 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-4f16edfc-4fb6-46ff-9f5d-9155090a1364 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:13.508632 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-4f16edfc-4fb6-46ff-9f5d-9155090a1364 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:13.568978 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-4f16edfc-4fb6-46ff-9f5d-9155090a1364 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b019715a14074e059730965913694e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b66ddee4c864aae90b738695dffbeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:13.576164 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-4f16edfc-4fb6-46ff-9f5d-9155090a1364 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] 10.222.0.79 "GET /compute/v2.1/servers/f529663e-c976-44f4-b501-5c3469c86721" status: 200 len: 1222 microversion: 2.1 time: 0.079630 Jan 28 02:08:13.576718 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 183/366] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:08:13 2022] GET /compute/v2.1/servers/f529663e-c976-44f4-b501-5c3469c86721 => generated 1222 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:08:13.799450 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-5cb990c2-c964-47df-ae10-0ac2de4ff168 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:13.800069 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-5cb990c2-c964-47df-ae10-0ac2de4ff168 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] [instance: ec5e47ac-761b-467f-958c-516a9f8bc3e6] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:13.807398 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-5cb990c2-c964-47df-ae10-0ac2de4ff168 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:13.807838 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-5cb990c2-c964-47df-ae10-0ac2de4ff168 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:13.808634 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-5cb990c2-c964-47df-ae10-0ac2de4ff168 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:13.809063 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-5cb990c2-c964-47df-ae10-0ac2de4ff168 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:13.949187 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-5cb990c2-c964-47df-ae10-0ac2de4ff168 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd7039b8f074a13b2030a2bb7aaff94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc19a0f9c33f47f1b504bebbb0b2c931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:13.958133 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-5cb990c2-c964-47df-ae10-0ac2de4ff168 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] 10.222.0.79 "GET /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6" status: 200 len: 1509 microversion: 2.1 time: 0.163143 Jan 28 02:08:13.958711 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 184/367] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:08:13 2022] GET /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6 => generated 1509 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:08:14.515869 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-103cf93c-9598-4093-98f1-8ded8dbe78b2 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:14.516535 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-103cf93c-9598-4093-98f1-8ded8dbe78b2 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:14.522365 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-103cf93c-9598-4093-98f1-8ded8dbe78b2 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:14.522796 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-103cf93c-9598-4093-98f1-8ded8dbe78b2 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:14.523550 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-103cf93c-9598-4093-98f1-8ded8dbe78b2 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:14.523990 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-103cf93c-9598-4093-98f1-8ded8dbe78b2 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:14.645726 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-103cf93c-9598-4093-98f1-8ded8dbe78b2 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:14.655942 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-103cf93c-9598-4093-98f1-8ded8dbe78b2 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:14.655942 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-103cf93c-9598-4093-98f1-8ded8dbe78b2 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:14.656317 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-103cf93c-9598-4093-98f1-8ded8dbe78b2 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84" status: 200 len: 1723 microversion: 2.20 time: 0.145098 Jan 28 02:08:14.656866 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 185/368] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:08:14 2022] GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84 => generated 1723 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 02:08:14.661142 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-47c5758a-6f6d-4c05-9ccd-10320c738b85 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:14.661728 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-47c5758a-6f6d-4c05-9ccd-10320c738b85 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] [instance: f529663e-c976-44f4-b501-5c3469c86721] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:14.667475 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-47c5758a-6f6d-4c05-9ccd-10320c738b85 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:14.667907 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-47c5758a-6f6d-4c05-9ccd-10320c738b85 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:14.668690 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-47c5758a-6f6d-4c05-9ccd-10320c738b85 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:14.669113 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-47c5758a-6f6d-4c05-9ccd-10320c738b85 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:14.735337 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-47c5758a-6f6d-4c05-9ccd-10320c738b85 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b019715a14074e059730965913694e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b66ddee4c864aae90b738695dffbeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:14.742923 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-47c5758a-6f6d-4c05-9ccd-10320c738b85 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] 10.222.0.79 "GET /compute/v2.1/servers/f529663e-c976-44f4-b501-5c3469c86721" status: 200 len: 1222 microversion: 2.1 time: 0.085052 Jan 28 02:08:14.743593 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 186/369] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:08:14 2022] GET /compute/v2.1/servers/f529663e-c976-44f4-b501-5c3469c86721 => generated 1222 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:08:14.788291 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-195d3883-06fb-41e2-a7fb-24d5322718d1 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "POST /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5/action" status: 200 len: 38136 microversion: 2.1 time: 2.198304 Jan 28 02:08:14.788937 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 184/370] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Jan 28 02:08:12 2022] POST /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5/action => generated 38136 bytes in 2200 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 02:08:14.976303 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-9382f941-f83b-4b76-8040-705be0a8e049 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:14.976900 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-9382f941-f83b-4b76-8040-705be0a8e049 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] [instance: ec5e47ac-761b-467f-958c-516a9f8bc3e6] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:14.982659 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-9382f941-f83b-4b76-8040-705be0a8e049 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:14.983101 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-9382f941-f83b-4b76-8040-705be0a8e049 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:14.984585 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-9382f941-f83b-4b76-8040-705be0a8e049 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:14.985462 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-9382f941-f83b-4b76-8040-705be0a8e049 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:15.175820 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-9382f941-f83b-4b76-8040-705be0a8e049 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd7039b8f074a13b2030a2bb7aaff94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc19a0f9c33f47f1b504bebbb0b2c931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:15.183548 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-9382f941-f83b-4b76-8040-705be0a8e049 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] 10.222.0.79 "GET /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6" status: 200 len: 1509 microversion: 2.1 time: 0.210779 Jan 28 02:08:15.188624 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 187/371] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:08:14 2022] GET /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6 => generated 1509 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:08:15.676581 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-bdec984b-2db3-49a0-a6c7-e256833db127 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:15.677470 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-bdec984b-2db3-49a0-a6c7-e256833db127 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:15.684174 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-bdec984b-2db3-49a0-a6c7-e256833db127 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:15.694208 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-bdec984b-2db3-49a0-a6c7-e256833db127 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:15.694208 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-bdec984b-2db3-49a0-a6c7-e256833db127 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:15.694208 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-bdec984b-2db3-49a0-a6c7-e256833db127 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:15.761168 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-7eb04fd0-7d73-41a7-ac67-d674de74c658 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:15.761998 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-7eb04fd0-7d73-41a7-ac67-d674de74c658 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] [instance: f529663e-c976-44f4-b501-5c3469c86721] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:15.769656 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-7eb04fd0-7d73-41a7-ac67-d674de74c658 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:15.770101 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-7eb04fd0-7d73-41a7-ac67-d674de74c658 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:15.770869 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-7eb04fd0-7d73-41a7-ac67-d674de74c658 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:15.771329 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-7eb04fd0-7d73-41a7-ac67-d674de74c658 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:15.842313 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-7eb04fd0-7d73-41a7-ac67-d674de74c658 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b019715a14074e059730965913694e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b66ddee4c864aae90b738695dffbeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:15.845165 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-bdec984b-2db3-49a0-a6c7-e256833db127 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:15.849724 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-7eb04fd0-7d73-41a7-ac67-d674de74c658 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] 10.222.0.79 "GET /compute/v2.1/servers/f529663e-c976-44f4-b501-5c3469c86721" status: 200 len: 1270 microversion: 2.1 time: 0.092888 Jan 28 02:08:15.850279 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 188/372] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:08:15 2022] GET /compute/v2.1/servers/f529663e-c976-44f4-b501-5c3469c86721 => generated 1270 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:08:15.853368 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-bdec984b-2db3-49a0-a6c7-e256833db127 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:15.857803 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-d3c4a0f5-520f-4e7f-8275-6726ac1715aa tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:08:15.857929 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-bdec984b-2db3-49a0-a6c7-e256833db127 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:15.858017 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-d3c4a0f5-520f-4e7f-8275-6726ac1715aa tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: d5f49055-da38-486c-9f10-1658c64d46f5] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:15.858097 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-bdec984b-2db3-49a0-a6c7-e256833db127 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84" status: 200 len: 1723 microversion: 2.20 time: 0.183754 Jan 28 02:08:15.858097 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 185/373] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:08:15 2022] GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84 => generated 1723 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 02:08:15.864331 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-d3c4a0f5-520f-4e7f-8275-6726ac1715aa tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:15.864840 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-d3c4a0f5-520f-4e7f-8275-6726ac1715aa tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:15.865707 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-d3c4a0f5-520f-4e7f-8275-6726ac1715aa tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:15.866406 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-d3c4a0f5-520f-4e7f-8275-6726ac1715aa tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:15.986352 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-d3c4a0f5-520f-4e7f-8275-6726ac1715aa tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "POST /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5/action" status: 200 len: 38144 microversion: 2.1 time: 0.134490 Jan 28 02:08:15.986931 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 189/374] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Jan 28 02:08:15 2022] POST /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5/action => generated 38144 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 02:08:16.200547 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-7d6601ea-3dfe-4e2a-9a0a-3af0c9ed5e3a tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:16.201234 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-7d6601ea-3dfe-4e2a-9a0a-3af0c9ed5e3a tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] [instance: ec5e47ac-761b-467f-958c-516a9f8bc3e6] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:16.207572 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-7d6601ea-3dfe-4e2a-9a0a-3af0c9ed5e3a tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:16.208065 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-7d6601ea-3dfe-4e2a-9a0a-3af0c9ed5e3a tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:16.208843 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-7d6601ea-3dfe-4e2a-9a0a-3af0c9ed5e3a tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:16.209272 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-7d6601ea-3dfe-4e2a-9a0a-3af0c9ed5e3a tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:16.391632 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-7d6601ea-3dfe-4e2a-9a0a-3af0c9ed5e3a tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd7039b8f074a13b2030a2bb7aaff94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc19a0f9c33f47f1b504bebbb0b2c931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:16.398978 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-7d6601ea-3dfe-4e2a-9a0a-3af0c9ed5e3a tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] 10.222.0.79 "GET /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6" status: 200 len: 1509 microversion: 2.1 time: 0.202145 Jan 28 02:08:16.399764 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 186/375] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:08:16 2022] GET /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6 => generated 1509 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:08:16.867777 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-9bbeac97-66ac-4ad2-a2ce-03f7a0f71aef tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:16.868536 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-9bbeac97-66ac-4ad2-a2ce-03f7a0f71aef tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] [instance: f529663e-c976-44f4-b501-5c3469c86721] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:16.874911 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-9bbeac97-66ac-4ad2-a2ce-03f7a0f71aef tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:16.875420 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-9bbeac97-66ac-4ad2-a2ce-03f7a0f71aef tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:16.876300 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-9bbeac97-66ac-4ad2-a2ce-03f7a0f71aef tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:16.877161 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-9bbeac97-66ac-4ad2-a2ce-03f7a0f71aef tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:16.877291 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-62372320-4eae-4b27-864e-44ad24e07590 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:16.877853 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-62372320-4eae-4b27-864e-44ad24e07590 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:16.890600 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-62372320-4eae-4b27-864e-44ad24e07590 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:16.892667 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-62372320-4eae-4b27-864e-44ad24e07590 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:16.894477 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-62372320-4eae-4b27-864e-44ad24e07590 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:16.895643 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-62372320-4eae-4b27-864e-44ad24e07590 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:17.270794 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-9bbeac97-66ac-4ad2-a2ce-03f7a0f71aef tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b019715a14074e059730965913694e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b66ddee4c864aae90b738695dffbeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:17.280524 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-9bbeac97-66ac-4ad2-a2ce-03f7a0f71aef tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] 10.222.0.79 "GET /compute/v2.1/servers/f529663e-c976-44f4-b501-5c3469c86721" status: 200 len: 1318 microversion: 2.1 time: 0.415599 Jan 28 02:08:17.281573 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 190/376] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:08:16 2022] GET /compute/v2.1/servers/f529663e-c976-44f4-b501-5c3469c86721 => generated 1318 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:08:17.287619 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-ce3f6313-80ad-4bc4-a362-999f85d6926b tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:08:17.288898 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-ce3f6313-80ad-4bc4-a362-999f85d6926b tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: d5f49055-da38-486c-9f10-1658c64d46f5] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:17.295187 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ce3f6313-80ad-4bc4-a362-999f85d6926b tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:17.296628 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ce3f6313-80ad-4bc4-a362-999f85d6926b tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:17.299247 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ce3f6313-80ad-4bc4-a362-999f85d6926b tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:17.299247 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ce3f6313-80ad-4bc4-a362-999f85d6926b tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:17.305824 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-62372320-4eae-4b27-864e-44ad24e07590 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:17.313861 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-62372320-4eae-4b27-864e-44ad24e07590 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:17.315319 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-62372320-4eae-4b27-864e-44ad24e07590 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:17.326108 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-62372320-4eae-4b27-864e-44ad24e07590 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84" status: 200 len: 1723 microversion: 2.20 time: 0.443895 Jan 28 02:08:17.327104 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 187/377] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:08:16 2022] GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84 => generated 1723 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 02:08:17.417310 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-9db07fc1-092e-4b47-b2ff-e2dc13fb1666 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:17.417905 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-9db07fc1-092e-4b47-b2ff-e2dc13fb1666 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] [instance: ec5e47ac-761b-467f-958c-516a9f8bc3e6] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:17.424711 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-9db07fc1-092e-4b47-b2ff-e2dc13fb1666 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:17.425304 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-9db07fc1-092e-4b47-b2ff-e2dc13fb1666 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:17.425929 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-9db07fc1-092e-4b47-b2ff-e2dc13fb1666 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:17.426352 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-9db07fc1-092e-4b47-b2ff-e2dc13fb1666 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:17.440954 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-ce3f6313-80ad-4bc4-a362-999f85d6926b tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "POST /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5/action" status: 200 len: 38263 microversion: 2.1 time: 0.157248 Jan 28 02:08:17.442030 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 191/378] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Jan 28 02:08:17 2022] POST /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5/action => generated 38263 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 02:08:17.452359 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-33566eea-5710-4b46-be45-29b401bfbce7 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:17.452928 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-33566eea-5710-4b46-be45-29b401bfbce7 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: d5f49055-da38-486c-9f10-1658c64d46f5] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:17.460389 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-33566eea-5710-4b46-be45-29b401bfbce7 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:17.460623 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-33566eea-5710-4b46-be45-29b401bfbce7 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:17.461419 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-33566eea-5710-4b46-be45-29b401bfbce7 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:17.461826 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-33566eea-5710-4b46-be45-29b401bfbce7 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:17.512637 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-33566eea-5710-4b46-be45-29b401bfbce7 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "GET /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5/ips" status: 200 len: 145 microversion: 2.1 time: 0.064205 Jan 28 02:08:17.513225 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 192/379] 10.222.0.79 () {58 vars in 1247 bytes} [Fri Jan 28 02:08:17 2022] GET /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5/ips => generated 145 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 02:08:17.736927 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-9db07fc1-092e-4b47-b2ff-e2dc13fb1666 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd7039b8f074a13b2030a2bb7aaff94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc19a0f9c33f47f1b504bebbb0b2c931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:17.745097 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-9db07fc1-092e-4b47-b2ff-e2dc13fb1666 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] 10.222.0.79 "GET /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6" status: 200 len: 1509 microversion: 2.1 time: 0.331372 Jan 28 02:08:17.745986 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 188/380] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:08:17 2022] GET /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6 => generated 1509 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:08:18.298756 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-67bf7aa5-c3f7-47cc-a98b-4bbe5acc3ec6 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:18.299362 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-67bf7aa5-c3f7-47cc-a98b-4bbe5acc3ec6 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] [instance: f529663e-c976-44f4-b501-5c3469c86721] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:18.305715 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-67bf7aa5-c3f7-47cc-a98b-4bbe5acc3ec6 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:18.306120 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-67bf7aa5-c3f7-47cc-a98b-4bbe5acc3ec6 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:18.306907 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-67bf7aa5-c3f7-47cc-a98b-4bbe5acc3ec6 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:18.307345 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-67bf7aa5-c3f7-47cc-a98b-4bbe5acc3ec6 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:18.345141 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-31cc79f1-c2f3-46ff-a50c-9056be5568bd tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:18.346580 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-31cc79f1-c2f3-46ff-a50c-9056be5568bd tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:18.357189 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-31cc79f1-c2f3-46ff-a50c-9056be5568bd tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:18.357189 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-31cc79f1-c2f3-46ff-a50c-9056be5568bd tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:18.357189 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-31cc79f1-c2f3-46ff-a50c-9056be5568bd tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:18.357189 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-31cc79f1-c2f3-46ff-a50c-9056be5568bd tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:18.765445 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-31cc79f1-c2f3-46ff-a50c-9056be5568bd tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:18.773508 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-31cc79f1-c2f3-46ff-a50c-9056be5568bd tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:18.775181 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-31cc79f1-c2f3-46ff-a50c-9056be5568bd tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:18.777632 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-31cc79f1-c2f3-46ff-a50c-9056be5568bd tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84" status: 200 len: 1723 microversion: 2.20 time: 0.436216 Jan 28 02:08:18.778380 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 189/381] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:08:18 2022] GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84 => generated 1723 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 02:08:18.784446 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [req-91799eca-a7f3-4d84-97a6-0ee7391b6448 req-5ff7d6af-7d63-4b1a-9f71-b37ef6ebf7c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f529663e-c976-44f4-b501-5c3469c86721", "tag": "a8128aba-f6b8-4d67-8aeb-48bca91f2e98"}]} {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:08:18.787134 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:08:18.787134 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: warnings.warn(msg) Jan 28 02:08:18.799866 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-67bf7aa5-c3f7-47cc-a98b-4bbe5acc3ec6 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b019715a14074e059730965913694e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b66ddee4c864aae90b738695dffbeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:18.808738 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [req-91799eca-a7f3-4d84-97a6-0ee7391b6448 req-5ff7d6af-7d63-4b1a-9f71-b37ef6ebf7c0 service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:18.809793 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-67bf7aa5-c3f7-47cc-a98b-4bbe5acc3ec6 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] 10.222.0.79 "GET /compute/v2.1/servers/f529663e-c976-44f4-b501-5c3469c86721" status: 200 len: 1318 microversion: 2.1 time: 0.513705 Jan 28 02:08:18.810375 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 193/382] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:08:18 2022] GET /compute/v2.1/servers/f529663e-c976-44f4-b501-5c3469c86721 => generated 1318 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:08:18.810743 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [req-91799eca-a7f3-4d84-97a6-0ee7391b6448 req-5ff7d6af-7d63-4b1a-9f71-b37ef6ebf7c0 service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:18.828772 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-bb98e3da-ac29-4ef1-8773-70e421ce5cee tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:18.829725 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-bb98e3da-ac29-4ef1-8773-70e421ce5cee tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] [instance: ec5e47ac-761b-467f-958c-516a9f8bc3e6] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:18.838709 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.compute.server_external_events [req-91799eca-a7f3-4d84-97a6-0ee7391b6448 req-5ff7d6af-7d63-4b1a-9f71-b37ef6ebf7c0 service nova] Creating event network-changed:a8128aba-f6b8-4d67-8aeb-48bca91f2e98 for instance f529663e-c976-44f4-b501-5c3469c86721 on hv-cinder-82497 Jan 28 02:08:18.841886 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-bb98e3da-ac29-4ef1-8773-70e421ce5cee tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:18.845359 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-bb98e3da-ac29-4ef1-8773-70e421ce5cee tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:18.846535 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-bb98e3da-ac29-4ef1-8773-70e421ce5cee tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:18.847447 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-bb98e3da-ac29-4ef1-8773-70e421ce5cee tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:18.857276 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [req-91799eca-a7f3-4d84-97a6-0ee7391b6448 req-5ff7d6af-7d63-4b1a-9f71-b37ef6ebf7c0 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077207 Jan 28 02:08:18.858127 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 190/383] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Jan 28 02:08:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:08:19.162191 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-bb98e3da-ac29-4ef1-8773-70e421ce5cee tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd7039b8f074a13b2030a2bb7aaff94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc19a0f9c33f47f1b504bebbb0b2c931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:19.172804 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-bb98e3da-ac29-4ef1-8773-70e421ce5cee tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] 10.222.0.79 "GET /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6" status: 200 len: 1515 microversion: 2.1 time: 0.355683 Jan 28 02:08:19.175786 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 194/384] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:08:18 2022] GET /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6 => generated 1515 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:08:19.798059 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-d359457e-4552-49f6-9e13-c06fa3cf6574 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:19.798869 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-d359457e-4552-49f6-9e13-c06fa3cf6574 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:19.806647 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-d359457e-4552-49f6-9e13-c06fa3cf6574 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:19.807272 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-d359457e-4552-49f6-9e13-c06fa3cf6574 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:19.808290 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-d359457e-4552-49f6-9e13-c06fa3cf6574 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:19.808863 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-d359457e-4552-49f6-9e13-c06fa3cf6574 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:19.827628 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-1c951065-9521-4b34-82c6-a5632500fa7e tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:19.829202 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-1c951065-9521-4b34-82c6-a5632500fa7e tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] [instance: f529663e-c976-44f4-b501-5c3469c86721] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:19.839643 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-1c951065-9521-4b34-82c6-a5632500fa7e tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:19.840949 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-1c951065-9521-4b34-82c6-a5632500fa7e tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:19.842969 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-1c951065-9521-4b34-82c6-a5632500fa7e tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:19.845854 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-1c951065-9521-4b34-82c6-a5632500fa7e tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:20.215146 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-d359457e-4552-49f6-9e13-c06fa3cf6574 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:20.224908 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-d359457e-4552-49f6-9e13-c06fa3cf6574 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:20.225571 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-1c951065-9521-4b34-82c6-a5632500fa7e tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b019715a14074e059730965913694e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b66ddee4c864aae90b738695dffbeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:20.227017 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-d359457e-4552-49f6-9e13-c06fa3cf6574 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:20.229435 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-d359457e-4552-49f6-9e13-c06fa3cf6574 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84" status: 200 len: 1723 microversion: 2.20 time: 0.435769 Jan 28 02:08:20.242550 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 191/385] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:08:19 2022] GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84 => generated 1723 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:08:20.248367 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-1c951065-9521-4b34-82c6-a5632500fa7e tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] 10.222.0.79 "GET /compute/v2.1/servers/f529663e-c976-44f4-b501-5c3469c86721" status: 200 len: 1318 microversion: 2.1 time: 0.424615 Jan 28 02:08:20.260102 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 195/386] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:08:19 2022] GET /compute/v2.1/servers/f529663e-c976-44f4-b501-5c3469c86721 => generated 1318 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:08:21.057645 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-a4110d79-a74c-4682-a0cc-7102f4f9164f tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "856a7cc8-e8f8-4bd9-8ead-ecca47c1f9b5"}} {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:08:21.058969 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-a4110d79-a74c-4682-a0cc-7102f4f9164f tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: d5f49055-da38-486c-9f10-1658c64d46f5] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:21.079858 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-a4110d79-a74c-4682-a0cc-7102f4f9164f tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:21.079858 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-a4110d79-a74c-4682-a0cc-7102f4f9164f tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:21.086319 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-a4110d79-a74c-4682-a0cc-7102f4f9164f tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:21.087177 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-a4110d79-a74c-4682-a0cc-7102f4f9164f tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:21.250760 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-4494eaea-95bf-4aa2-8f40-552eae8d89be tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:21.251310 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-4494eaea-95bf-4aa2-8f40-552eae8d89be tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:21.265351 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-4494eaea-95bf-4aa2-8f40-552eae8d89be tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:21.267990 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-4494eaea-95bf-4aa2-8f40-552eae8d89be tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:21.267990 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-4494eaea-95bf-4aa2-8f40-552eae8d89be tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:21.268971 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-4494eaea-95bf-4aa2-8f40-552eae8d89be tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:21.493435 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-4494eaea-95bf-4aa2-8f40-552eae8d89be tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:21.508676 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-4494eaea-95bf-4aa2-8f40-552eae8d89be tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:21.513849 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-4494eaea-95bf-4aa2-8f40-552eae8d89be tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:21.522212 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-4494eaea-95bf-4aa2-8f40-552eae8d89be tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84" status: 200 len: 1723 microversion: 2.20 time: 0.270198 Jan 28 02:08:21.522952 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 196/387] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:08:21 2022] GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84 => generated 1723 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:08:21.532401 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-12bc1e9f-a670-4992-af73-6e4020da8cf6 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:21.535034 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-12bc1e9f-a670-4992-af73-6e4020da8cf6 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] [instance: f529663e-c976-44f4-b501-5c3469c86721] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:21.546688 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-12bc1e9f-a670-4992-af73-6e4020da8cf6 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:21.546688 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-12bc1e9f-a670-4992-af73-6e4020da8cf6 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:21.546688 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-12bc1e9f-a670-4992-af73-6e4020da8cf6 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:21.546688 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-12bc1e9f-a670-4992-af73-6e4020da8cf6 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:21.848724 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-12bc1e9f-a670-4992-af73-6e4020da8cf6 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b019715a14074e059730965913694e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b66ddee4c864aae90b738695dffbeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:21.857427 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-12bc1e9f-a670-4992-af73-6e4020da8cf6 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] 10.222.0.79 "GET /compute/v2.1/servers/f529663e-c976-44f4-b501-5c3469c86721" status: 200 len: 1318 microversion: 2.1 time: 0.333191 Jan 28 02:08:21.868242 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 197/388] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:08:21 2022] GET /compute/v2.1/servers/f529663e-c976-44f4-b501-5c3469c86721 => generated 1318 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:08:22.073180 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-a4110d79-a74c-4682-a0cc-7102f4f9164f tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "POST /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.020974 Jan 28 02:08:22.076711 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 192/389] 10.222.0.79 () {60 vars in 1322 bytes} [Fri Jan 28 02:08:21 2022] POST /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5/os-volume_attachments => generated 194 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:08:22.221432 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-86e5d107-1462-4392-8160-1c851f711c97 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:22.222312 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-86e5d107-1462-4392-8160-1c851f711c97 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] [instance: ec5e47ac-761b-467f-958c-516a9f8bc3e6] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:22.229039 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-86e5d107-1462-4392-8160-1c851f711c97 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:22.229880 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-86e5d107-1462-4392-8160-1c851f711c97 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:22.230868 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-86e5d107-1462-4392-8160-1c851f711c97 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:22.231445 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-86e5d107-1462-4392-8160-1c851f711c97 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:22.428591 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-86e5d107-1462-4392-8160-1c851f711c97 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd7039b8f074a13b2030a2bb7aaff94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc19a0f9c33f47f1b504bebbb0b2c931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:22.437410 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-86e5d107-1462-4392-8160-1c851f711c97 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] 10.222.0.79 "GET /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6" status: 200 len: 1515 microversion: 2.1 time: 0.221897 Jan 28 02:08:22.448365 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 198/390] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:08:22 2022] GET /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6 => generated 1515 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:08:22.463535 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-92d7cdfb-8a6d-40f3-869b-6538161ec49f tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "86479932-7d1f-45f3-9fec-b01e2a4a4f70"}} {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:08:22.465534 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-92d7cdfb-8a6d-40f3-869b-6538161ec49f tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] [instance: ec5e47ac-761b-467f-958c-516a9f8bc3e6] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:22.476007 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-92d7cdfb-8a6d-40f3-869b-6538161ec49f tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:22.476459 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-92d7cdfb-8a6d-40f3-869b-6538161ec49f tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:22.477558 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-92d7cdfb-8a6d-40f3-869b-6538161ec49f tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:22.481238 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-92d7cdfb-8a6d-40f3-869b-6538161ec49f tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:22.541915 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-478116de-3815-4450-b9f9-7cac2e79d6c9 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:22.542530 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-478116de-3815-4450-b9f9-7cac2e79d6c9 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:22.556112 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-478116de-3815-4450-b9f9-7cac2e79d6c9 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:22.556112 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-478116de-3815-4450-b9f9-7cac2e79d6c9 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:22.556112 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-478116de-3815-4450-b9f9-7cac2e79d6c9 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:22.556112 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-478116de-3815-4450-b9f9-7cac2e79d6c9 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:22.719847 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-478116de-3815-4450-b9f9-7cac2e79d6c9 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:22.728832 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-478116de-3815-4450-b9f9-7cac2e79d6c9 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:22.730628 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-478116de-3815-4450-b9f9-7cac2e79d6c9 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:22.732044 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-478116de-3815-4450-b9f9-7cac2e79d6c9 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84" status: 200 len: 1723 microversion: 2.20 time: 0.194316 Jan 28 02:08:22.734290 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 199/391] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:08:22 2022] GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84 => generated 1723 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 02:08:22.876089 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-94442c49-f32f-46d1-a750-45ca88eb327a tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:22.876967 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-94442c49-f32f-46d1-a750-45ca88eb327a tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] [instance: f529663e-c976-44f4-b501-5c3469c86721] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:22.886464 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-94442c49-f32f-46d1-a750-45ca88eb327a tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:22.892493 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-94442c49-f32f-46d1-a750-45ca88eb327a tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:22.892493 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-94442c49-f32f-46d1-a750-45ca88eb327a tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:22.892493 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-94442c49-f32f-46d1-a750-45ca88eb327a tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:23.071036 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-94442c49-f32f-46d1-a750-45ca88eb327a tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b019715a14074e059730965913694e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b66ddee4c864aae90b738695dffbeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:23.096702 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-94442c49-f32f-46d1-a750-45ca88eb327a tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] 10.222.0.79 "GET /compute/v2.1/servers/f529663e-c976-44f4-b501-5c3469c86721" status: 200 len: 1318 microversion: 2.1 time: 0.207570 Jan 28 02:08:23.096702 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 200/392] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:08:22 2022] GET /compute/v2.1/servers/f529663e-c976-44f4-b501-5c3469c86721 => generated 1318 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:08:23.477270 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-92d7cdfb-8a6d-40f3-869b-6538161ec49f tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] 10.222.0.79 "POST /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.018073 Jan 28 02:08:23.478568 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 193/393] 10.222.0.79 () {60 vars in 1322 bytes} [Fri Jan 28 02:08:22 2022] POST /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6/os-volume_attachments => generated 194 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:08:23.752947 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-21cf11fd-70dd-4cb8-9aa4-425836e87cbe tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:23.753715 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-21cf11fd-70dd-4cb8-9aa4-425836e87cbe tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:23.770255 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-21cf11fd-70dd-4cb8-9aa4-425836e87cbe tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:23.774418 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-21cf11fd-70dd-4cb8-9aa4-425836e87cbe tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:23.774418 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-21cf11fd-70dd-4cb8-9aa4-425836e87cbe tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:23.778940 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-21cf11fd-70dd-4cb8-9aa4-425836e87cbe tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:24.107447 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-821c517a-d72b-43e3-b9cf-e778f7ee5e76 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:24.108383 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-821c517a-d72b-43e3-b9cf-e778f7ee5e76 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] [instance: f529663e-c976-44f4-b501-5c3469c86721] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:24.117099 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-821c517a-d72b-43e3-b9cf-e778f7ee5e76 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:24.117815 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-821c517a-d72b-43e3-b9cf-e778f7ee5e76 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:24.118798 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-821c517a-d72b-43e3-b9cf-e778f7ee5e76 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:24.119381 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-821c517a-d72b-43e3-b9cf-e778f7ee5e76 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:24.151324 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-21cf11fd-70dd-4cb8-9aa4-425836e87cbe tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:24.163079 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-21cf11fd-70dd-4cb8-9aa4-425836e87cbe tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:24.165893 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-21cf11fd-70dd-4cb8-9aa4-425836e87cbe tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:24.167793 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-21cf11fd-70dd-4cb8-9aa4-425836e87cbe tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84" status: 200 len: 1723 microversion: 2.20 time: 0.420905 Jan 28 02:08:24.168944 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 201/394] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:08:23 2022] GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84 => generated 1723 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:08:24.370713 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-821c517a-d72b-43e3-b9cf-e778f7ee5e76 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b019715a14074e059730965913694e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b66ddee4c864aae90b738695dffbeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:24.383512 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-821c517a-d72b-43e3-b9cf-e778f7ee5e76 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] 10.222.0.79 "GET /compute/v2.1/servers/f529663e-c976-44f4-b501-5c3469c86721" status: 200 len: 1318 microversion: 2.1 time: 0.280127 Jan 28 02:08:24.396134 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 194/395] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:08:24 2022] GET /compute/v2.1/servers/f529663e-c976-44f4-b501-5c3469c86721 => generated 1318 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:08:25.190057 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-94bdd53e-11e0-49c2-ac2e-c5fe7ce8d11a tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:25.191298 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-94bdd53e-11e0-49c2-ac2e-c5fe7ce8d11a tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:25.201196 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-94bdd53e-11e0-49c2-ac2e-c5fe7ce8d11a tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:25.202639 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-94bdd53e-11e0-49c2-ac2e-c5fe7ce8d11a tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:25.203682 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-94bdd53e-11e0-49c2-ac2e-c5fe7ce8d11a tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:25.206802 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-94bdd53e-11e0-49c2-ac2e-c5fe7ce8d11a tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:25.405581 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-e6eaff95-cd5b-43db-981d-86eaa119a8e2 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:25.406998 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-e6eaff95-cd5b-43db-981d-86eaa119a8e2 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] [instance: f529663e-c976-44f4-b501-5c3469c86721] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:25.416263 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-e6eaff95-cd5b-43db-981d-86eaa119a8e2 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:25.417778 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-e6eaff95-cd5b-43db-981d-86eaa119a8e2 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:25.419584 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-e6eaff95-cd5b-43db-981d-86eaa119a8e2 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:25.422138 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-e6eaff95-cd5b-43db-981d-86eaa119a8e2 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:25.432846 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-94bdd53e-11e0-49c2-ac2e-c5fe7ce8d11a tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:25.442659 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-94bdd53e-11e0-49c2-ac2e-c5fe7ce8d11a tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:25.446635 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-94bdd53e-11e0-49c2-ac2e-c5fe7ce8d11a tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:25.450448 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-94bdd53e-11e0-49c2-ac2e-c5fe7ce8d11a tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84" status: 200 len: 1744 microversion: 2.20 time: 0.267670 Jan 28 02:08:25.451192 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 202/396] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:08:25 2022] GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84 => generated 1744 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:08:25.719035 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-e6eaff95-cd5b-43db-981d-86eaa119a8e2 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b019715a14074e059730965913694e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b66ddee4c864aae90b738695dffbeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:25.731341 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-e6eaff95-cd5b-43db-981d-86eaa119a8e2 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] 10.222.0.79 "GET /compute/v2.1/servers/f529663e-c976-44f4-b501-5c3469c86721" status: 200 len: 1318 microversion: 2.1 time: 0.333506 Jan 28 02:08:25.748362 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 195/397] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:08:25 2022] GET /compute/v2.1/servers/f529663e-c976-44f4-b501-5c3469c86721 => generated 1318 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:08:26.471229 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-d34b81df-4a8d-4011-8e9f-bd2f5b67d36f tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:26.471948 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-d34b81df-4a8d-4011-8e9f-bd2f5b67d36f tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:26.480909 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-d34b81df-4a8d-4011-8e9f-bd2f5b67d36f tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:26.485195 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-d34b81df-4a8d-4011-8e9f-bd2f5b67d36f tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:26.487018 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-d34b81df-4a8d-4011-8e9f-bd2f5b67d36f tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:26.489538 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-d34b81df-4a8d-4011-8e9f-bd2f5b67d36f tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:26.657092 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-d34b81df-4a8d-4011-8e9f-bd2f5b67d36f tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:26.672926 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-d34b81df-4a8d-4011-8e9f-bd2f5b67d36f tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:26.674961 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-d34b81df-4a8d-4011-8e9f-bd2f5b67d36f tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:26.677321 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-d34b81df-4a8d-4011-8e9f-bd2f5b67d36f tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84" status: 200 len: 1744 microversion: 2.20 time: 0.211064 Jan 28 02:08:26.690623 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 203/398] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:08:26 2022] GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84 => generated 1744 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:08:26.750954 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-92ff7b5a-94cf-487a-8a96-163b9aadf89a tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:26.750954 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-92ff7b5a-94cf-487a-8a96-163b9aadf89a tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] [instance: f529663e-c976-44f4-b501-5c3469c86721] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:26.759228 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-92ff7b5a-94cf-487a-8a96-163b9aadf89a tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:26.759763 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-92ff7b5a-94cf-487a-8a96-163b9aadf89a tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:26.760799 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-92ff7b5a-94cf-487a-8a96-163b9aadf89a tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:26.761445 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-92ff7b5a-94cf-487a-8a96-163b9aadf89a tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:26.996210 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-92ff7b5a-94cf-487a-8a96-163b9aadf89a tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b019715a14074e059730965913694e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b66ddee4c864aae90b738695dffbeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:27.011114 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-92ff7b5a-94cf-487a-8a96-163b9aadf89a tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] 10.222.0.79 "GET /compute/v2.1/servers/f529663e-c976-44f4-b501-5c3469c86721" status: 200 len: 1318 microversion: 2.1 time: 0.265050 Jan 28 02:08:27.012383 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 196/399] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:08:26 2022] GET /compute/v2.1/servers/f529663e-c976-44f4-b501-5c3469c86721 => generated 1318 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:08:27.588680 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [req-e870f0c4-b7aa-4dc2-9f11-fdf13d84057f req-16960dad-32b1-4f9e-85ea-d10bd5817e4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f529663e-c976-44f4-b501-5c3469c86721", "name": "network-vif-plugged", "status": "completed", "tag": "a8128aba-f6b8-4d67-8aeb-48bca91f2e98"}]} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:08:27.591101 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:08:27.591101 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: warnings.warn(msg) Jan 28 02:08:27.600055 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-e870f0c4-b7aa-4dc2-9f11-fdf13d84057f req-16960dad-32b1-4f9e-85ea-d10bd5817e4c service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:27.600775 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-e870f0c4-b7aa-4dc2-9f11-fdf13d84057f req-16960dad-32b1-4f9e-85ea-d10bd5817e4c service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:27.615539 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.compute.server_external_events [req-e870f0c4-b7aa-4dc2-9f11-fdf13d84057f req-16960dad-32b1-4f9e-85ea-d10bd5817e4c service nova] Creating event network-vif-plugged:a8128aba-f6b8-4d67-8aeb-48bca91f2e98 for instance f529663e-c976-44f4-b501-5c3469c86721 on hv-cinder-82497 Jan 28 02:08:27.621333 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [req-e870f0c4-b7aa-4dc2-9f11-fdf13d84057f req-16960dad-32b1-4f9e-85ea-d10bd5817e4c service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036573 Jan 28 02:08:27.622510 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 204/400] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Jan 28 02:08:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:08:27.705382 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-bfaff20c-bff1-4382-a129-0c509e217de1 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:27.705999 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-bfaff20c-bff1-4382-a129-0c509e217de1 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:27.718164 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-bfaff20c-bff1-4382-a129-0c509e217de1 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:27.718379 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-bfaff20c-bff1-4382-a129-0c509e217de1 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:27.719299 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-bfaff20c-bff1-4382-a129-0c509e217de1 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:27.719738 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-bfaff20c-bff1-4382-a129-0c509e217de1 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:27.918731 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-bfaff20c-bff1-4382-a129-0c509e217de1 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:27.947715 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-bfaff20c-bff1-4382-a129-0c509e217de1 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:27.947715 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-bfaff20c-bff1-4382-a129-0c509e217de1 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:27.947715 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-bfaff20c-bff1-4382-a129-0c509e217de1 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84" status: 200 len: 1739 microversion: 2.20 time: 0.242108 Jan 28 02:08:27.948136 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 197/401] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:08:27 2022] GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84 => generated 1739 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:08:28.064743 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-4e349133-06b5-4da3-a7ea-486f731240a8 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:28.065743 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-4e349133-06b5-4da3-a7ea-486f731240a8 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] [instance: f529663e-c976-44f4-b501-5c3469c86721] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:28.107177 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-4e349133-06b5-4da3-a7ea-486f731240a8 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:28.110267 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-4e349133-06b5-4da3-a7ea-486f731240a8 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:28.111241 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-4e349133-06b5-4da3-a7ea-486f731240a8 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:28.114649 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-4e349133-06b5-4da3-a7ea-486f731240a8 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:28.388024 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-4e349133-06b5-4da3-a7ea-486f731240a8 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b019715a14074e059730965913694e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b66ddee4c864aae90b738695dffbeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:28.414385 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-4e349133-06b5-4da3-a7ea-486f731240a8 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] 10.222.0.79 "GET /compute/v2.1/servers/f529663e-c976-44f4-b501-5c3469c86721" status: 200 len: 1318 microversion: 2.1 time: 0.376733 Jan 28 02:08:28.416103 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 205/402] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:08:28 2022] GET /compute/v2.1/servers/f529663e-c976-44f4-b501-5c3469c86721 => generated 1318 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:08:28.954626 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-ae55b5de-349a-4a9e-8386-f0433dfe46e0 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:28.955282 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-ae55b5de-349a-4a9e-8386-f0433dfe46e0 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:28.973908 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-ae55b5de-349a-4a9e-8386-f0433dfe46e0 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:28.974361 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-ae55b5de-349a-4a9e-8386-f0433dfe46e0 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:28.975393 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-ae55b5de-349a-4a9e-8386-f0433dfe46e0 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:28.976006 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-ae55b5de-349a-4a9e-8386-f0433dfe46e0 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:29.435193 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-0abebf5e-9bac-49d0-bc3c-65f00a8020f8 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:29.435738 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-ae55b5de-349a-4a9e-8386-f0433dfe46e0 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:29.436911 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-0abebf5e-9bac-49d0-bc3c-65f00a8020f8 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] [instance: f529663e-c976-44f4-b501-5c3469c86721] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:29.456865 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-0abebf5e-9bac-49d0-bc3c-65f00a8020f8 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:29.461563 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-ae55b5de-349a-4a9e-8386-f0433dfe46e0 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:29.462269 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-0abebf5e-9bac-49d0-bc3c-65f00a8020f8 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:29.463386 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-0abebf5e-9bac-49d0-bc3c-65f00a8020f8 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:29.468183 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-0abebf5e-9bac-49d0-bc3c-65f00a8020f8 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:29.470677 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-ae55b5de-349a-4a9e-8386-f0433dfe46e0 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:29.479687 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-ae55b5de-349a-4a9e-8386-f0433dfe46e0 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84" status: 200 len: 1739 microversion: 2.20 time: 0.526031 Jan 28 02:08:29.485329 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 198/403] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:08:28 2022] GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84 => generated 1739 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:08:29.735795 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [req-e192e014-b880-43ec-9e45-cf177a337924 req-9d9e284b-0d8d-40e4-a2ba-df5ef12ed69f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f25403b-0399-48d0-86a9-6e5022287c84", "name": "network-vif-plugged", "status": "completed", "tag": "eb8f729a-b66f-4c5c-a62e-472c346922bb"}]} {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:08:29.739215 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:08:29.739215 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: warnings.warn(msg) Jan 28 02:08:29.771928 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [req-e192e014-b880-43ec-9e45-cf177a337924 req-9d9e284b-0d8d-40e4-a2ba-df5ef12ed69f service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:29.773769 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [req-e192e014-b880-43ec-9e45-cf177a337924 req-9d9e284b-0d8d-40e4-a2ba-df5ef12ed69f service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:29.781874 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-0abebf5e-9bac-49d0-bc3c-65f00a8020f8 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b019715a14074e059730965913694e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b66ddee4c864aae90b738695dffbeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:29.802134 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-0abebf5e-9bac-49d0-bc3c-65f00a8020f8 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] 10.222.0.79 "GET /compute/v2.1/servers/f529663e-c976-44f4-b501-5c3469c86721" status: 200 len: 1318 microversion: 2.1 time: 0.362693 Jan 28 02:08:29.804207 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 206/404] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:08:29 2022] GET /compute/v2.1/servers/f529663e-c976-44f4-b501-5c3469c86721 => generated 1318 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:08:29.809069 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.compute.server_external_events [req-e192e014-b880-43ec-9e45-cf177a337924 req-9d9e284b-0d8d-40e4-a2ba-df5ef12ed69f service nova] Creating event network-vif-plugged:eb8f729a-b66f-4c5c-a62e-472c346922bb for instance 4f25403b-0399-48d0-86a9-6e5022287c84 on hv-cinder-82497 Jan 28 02:08:29.835107 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [req-e192e014-b880-43ec-9e45-cf177a337924 req-9d9e284b-0d8d-40e4-a2ba-df5ef12ed69f service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105577 Jan 28 02:08:29.840933 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 199/405] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Jan 28 02:08:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:08:30.499423 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-24aaa9b6-54ce-412b-9e69-e9afdc26a09f tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:30.500161 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-24aaa9b6-54ce-412b-9e69-e9afdc26a09f tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:30.511050 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-24aaa9b6-54ce-412b-9e69-e9afdc26a09f tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:30.511761 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-24aaa9b6-54ce-412b-9e69-e9afdc26a09f tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:30.513208 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-24aaa9b6-54ce-412b-9e69-e9afdc26a09f tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:30.514082 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-24aaa9b6-54ce-412b-9e69-e9afdc26a09f tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:30.822230 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-bc7ee728-2c03-45d7-a29f-c5b5d35d93c4 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:30.823197 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-bc7ee728-2c03-45d7-a29f-c5b5d35d93c4 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] [instance: f529663e-c976-44f4-b501-5c3469c86721] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:30.847351 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-bc7ee728-2c03-45d7-a29f-c5b5d35d93c4 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:30.850978 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-bc7ee728-2c03-45d7-a29f-c5b5d35d93c4 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:30.850978 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-bc7ee728-2c03-45d7-a29f-c5b5d35d93c4 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:30.854821 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-bc7ee728-2c03-45d7-a29f-c5b5d35d93c4 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:31.033182 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-24aaa9b6-54ce-412b-9e69-e9afdc26a09f tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:31.046593 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-24aaa9b6-54ce-412b-9e69-e9afdc26a09f tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:31.049771 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-24aaa9b6-54ce-412b-9e69-e9afdc26a09f tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:31.051171 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-24aaa9b6-54ce-412b-9e69-e9afdc26a09f tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84" status: 200 len: 1739 microversion: 2.20 time: 0.556531 Jan 28 02:08:31.057784 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 207/406] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:08:30 2022] GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84 => generated 1739 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:08:31.161765 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-bc7ee728-2c03-45d7-a29f-c5b5d35d93c4 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b019715a14074e059730965913694e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b66ddee4c864aae90b738695dffbeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:31.175920 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-bc7ee728-2c03-45d7-a29f-c5b5d35d93c4 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] 10.222.0.79 "GET /compute/v2.1/servers/f529663e-c976-44f4-b501-5c3469c86721" status: 200 len: 1509 microversion: 2.1 time: 0.358243 Jan 28 02:08:31.177244 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 200/407] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:08:30 2022] GET /compute/v2.1/servers/f529663e-c976-44f4-b501-5c3469c86721 => generated 1509 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:08:31.195184 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-fc12e2ab-fb9b-40b2-b84f-7ad12ec57e5a tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "eb9e1d95-ba0d-465a-88ec-5bef9f42fb48"}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:08:31.197844 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-fc12e2ab-fb9b-40b2-b84f-7ad12ec57e5a tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] [instance: f529663e-c976-44f4-b501-5c3469c86721] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:31.208009 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-fc12e2ab-fb9b-40b2-b84f-7ad12ec57e5a tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:31.208462 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-fc12e2ab-fb9b-40b2-b84f-7ad12ec57e5a tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:31.209232 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-fc12e2ab-fb9b-40b2-b84f-7ad12ec57e5a tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:31.212279 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-fc12e2ab-fb9b-40b2-b84f-7ad12ec57e5a tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:31.373735 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-e325e566-35fe-4e90-b751-bc6669f25e49 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:08:31.382170 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-e325e566-35fe-4e90-b751-bc6669f25e49 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:31.382774 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-e325e566-35fe-4e90-b751-bc6669f25e49 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:31.495336 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.wsgi [None req-fc12e2ab-fb9b-40b2-b84f-7ad12ec57e5a tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] HTTP exception thrown: Invalid volume: volume eb9e1d95-ba0d-465a-88ec-5bef9f42fb48 is already attached to instances: f6852bd3-1574-4ae7-a78f-16f07931687b Jan 28 02:08:31.496043 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-fc12e2ab-fb9b-40b2-b84f-7ad12ec57e5a tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Returning 400 to user: Invalid volume: volume eb9e1d95-ba0d-465a-88ec-5bef9f42fb48 is already attached to instances: f6852bd3-1574-4ae7-a78f-16f07931687b {{(pid=116375) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 02:08:31.497978 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-fc12e2ab-fb9b-40b2-b84f-7ad12ec57e5a tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] 10.222.0.79 "POST /compute/v2.1/servers/f529663e-c976-44f4-b501-5c3469c86721/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.306991 Jan 28 02:08:31.502348 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 208/408] 10.222.0.79 () {60 vars in 1322 bytes} [Fri Jan 28 02:08:31 2022] POST /compute/v2.1/servers/f529663e-c976-44f4-b501-5c3469c86721/os-volume_attachments => generated 174 bytes in 312 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 28 02:08:31.534189 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-e325e566-35fe-4e90-b751-bc6669f25e49 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: d5f49055-da38-486c-9f10-1658c64d46f5] Going to try to stop instance {{(pid=116374) force_stop /opt/stack/nova/nova/compute/api.py:2652}} Jan 28 02:08:31.807682 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-e325e566-35fe-4e90-b751-bc6669f25e49 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "POST /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5/action" status: 202 len: 0 microversion: 2.1 time: 0.433017 Jan 28 02:08:31.807682 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 201/409] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Jan 28 02:08:31 2022] POST /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5/action => generated 0 bytes in 434 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:08:31.826075 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-06abdda7-16b1-435a-80e3-0d0d8a18ba67 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:31.828614 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-06abdda7-16b1-435a-80e3-0d0d8a18ba67 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: d5f49055-da38-486c-9f10-1658c64d46f5] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:31.838196 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-05f051e4-aaef-46d2-adac-14d44b53923a tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:31.838637 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-05f051e4-aaef-46d2-adac-14d44b53923a tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] [instance: f6852bd3-1574-4ae7-a78f-16f07931687b] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:31.868979 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-05f051e4-aaef-46d2-adac-14d44b53923a tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:31.871692 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-06abdda7-16b1-435a-80e3-0d0d8a18ba67 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:31.875755 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-06abdda7-16b1-435a-80e3-0d0d8a18ba67 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:31.879354 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-06abdda7-16b1-435a-80e3-0d0d8a18ba67 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:31.882794 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-06abdda7-16b1-435a-80e3-0d0d8a18ba67 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:31.902919 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-05f051e4-aaef-46d2-adac-14d44b53923a tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:31.904036 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-05f051e4-aaef-46d2-adac-14d44b53923a tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:31.904498 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-05f051e4-aaef-46d2-adac-14d44b53923a tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:32.238388 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-06abdda7-16b1-435a-80e3-0d0d8a18ba67 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acab2a0c4a0e48909317791a3de85b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abe012ba65845329098e0e06c54b9c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:32.257238 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-06abdda7-16b1-435a-80e3-0d0d8a18ba67 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "GET /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5" status: 200 len: 1723 microversion: 2.1 time: 0.448663 Jan 28 02:08:32.258381 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 209/410] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:08:31 2022] GET /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5 => generated 1723 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:08:32.270126 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-cec7c26a-9ca6-46d8-8e53-458751ee9e87 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:32.271747 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-cec7c26a-9ca6-46d8-8e53-458751ee9e87 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:32.291637 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-cec7c26a-9ca6-46d8-8e53-458751ee9e87 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:32.293211 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-cec7c26a-9ca6-46d8-8e53-458751ee9e87 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:32.294162 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-cec7c26a-9ca6-46d8-8e53-458751ee9e87 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:32.298902 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-cec7c26a-9ca6-46d8-8e53-458751ee9e87 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:32.318239 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.objects.instance [None req-05f051e4-aaef-46d2-adac-14d44b53923a tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lazy-loading 'services' on Instance uuid f6852bd3-1574-4ae7-a78f-16f07931687b {{(pid=116374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jan 28 02:08:32.621458 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-cec7c26a-9ca6-46d8-8e53-458751ee9e87 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:32.632894 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-cec7c26a-9ca6-46d8-8e53-458751ee9e87 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:32.634693 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-cec7c26a-9ca6-46d8-8e53-458751ee9e87 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:32.636843 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-cec7c26a-9ca6-46d8-8e53-458751ee9e87 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84" status: 200 len: 1739 microversion: 2.20 time: 0.376704 Jan 28 02:08:32.637975 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 210/411] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:08:32 2022] GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84 => generated 1739 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:08:32.875366 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-05f051e4-aaef-46d2-adac-14d44b53923a tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] 10.222.0.79 "DELETE /compute/v2.1/servers/f6852bd3-1574-4ae7-a78f-16f07931687b/os-volume_attachments/eb9e1d95-ba0d-465a-88ec-5bef9f42fb48" status: 202 len: 0 microversion: 2.1 time: 1.044977 Jan 28 02:08:32.875366 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 202/412] 10.222.0.79 () {58 vars in 1415 bytes} [Fri Jan 28 02:08:31 2022] DELETE /compute/v2.1/servers/f6852bd3-1574-4ae7-a78f-16f07931687b/os-volume_attachments/eb9e1d95-ba0d-465a-88ec-5bef9f42fb48 => generated 0 bytes in 1047 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 28 02:08:32.881218 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-8781f4bc-9226-44fe-bd02-9c1046c60d87 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:32.881708 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-8781f4bc-9226-44fe-bd02-9c1046c60d87 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] [instance: f6852bd3-1574-4ae7-a78f-16f07931687b] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:32.902947 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-8781f4bc-9226-44fe-bd02-9c1046c60d87 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:32.902947 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-8781f4bc-9226-44fe-bd02-9c1046c60d87 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:32.902947 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-8781f4bc-9226-44fe-bd02-9c1046c60d87 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:32.902947 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-8781f4bc-9226-44fe-bd02-9c1046c60d87 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:33.026809 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-8781f4bc-9226-44fe-bd02-9c1046c60d87 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] 10.222.0.79 "GET /compute/v2.1/servers/f6852bd3-1574-4ae7-a78f-16f07931687b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.150714 Jan 28 02:08:33.027382 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 211/413] 10.222.0.79 () {58 vars in 1301 bytes} [Fri Jan 28 02:08:32 2022] GET /compute/v2.1/servers/f6852bd3-1574-4ae7-a78f-16f07931687b/os-volume_attachments => generated 197 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:08:33.279176 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-65836910-0e3e-423b-bf6a-0cce42a46bbc tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:33.281370 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-65836910-0e3e-423b-bf6a-0cce42a46bbc tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: d5f49055-da38-486c-9f10-1658c64d46f5] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:33.305282 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-65836910-0e3e-423b-bf6a-0cce42a46bbc tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:33.306255 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-65836910-0e3e-423b-bf6a-0cce42a46bbc tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:33.310270 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-65836910-0e3e-423b-bf6a-0cce42a46bbc tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:33.310270 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-65836910-0e3e-423b-bf6a-0cce42a46bbc tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:33.668355 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-7cffa8cc-0ede-4f3d-9b56-a236f8842f1e tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:33.669612 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-7cffa8cc-0ede-4f3d-9b56-a236f8842f1e tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:33.692280 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-7cffa8cc-0ede-4f3d-9b56-a236f8842f1e tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:33.693075 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-7cffa8cc-0ede-4f3d-9b56-a236f8842f1e tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:33.694948 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-7cffa8cc-0ede-4f3d-9b56-a236f8842f1e tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:33.696701 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-7cffa8cc-0ede-4f3d-9b56-a236f8842f1e tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:33.715939 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-65836910-0e3e-423b-bf6a-0cce42a46bbc tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acab2a0c4a0e48909317791a3de85b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abe012ba65845329098e0e06c54b9c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:33.736331 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-65836910-0e3e-423b-bf6a-0cce42a46bbc tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "GET /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5" status: 200 len: 1723 microversion: 2.1 time: 0.465447 Jan 28 02:08:33.740067 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 203/414] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:08:33 2022] GET /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5 => generated 1723 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:08:33.966044 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-7cffa8cc-0ede-4f3d-9b56-a236f8842f1e tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:33.985845 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-7cffa8cc-0ede-4f3d-9b56-a236f8842f1e tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:33.986285 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-7cffa8cc-0ede-4f3d-9b56-a236f8842f1e tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:33.987699 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-7cffa8cc-0ede-4f3d-9b56-a236f8842f1e tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84" status: 200 len: 1739 microversion: 2.20 time: 0.328511 Jan 28 02:08:34.000295 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 212/415] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:08:33 2022] GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84 => generated 1739 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:08:34.045829 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-fc6dc7e0-c0d1-4ef9-9f6d-fa3502360286 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:34.051314 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-fc6dc7e0-c0d1-4ef9-9f6d-fa3502360286 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] [instance: f6852bd3-1574-4ae7-a78f-16f07931687b] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:34.058112 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-fc6dc7e0-c0d1-4ef9-9f6d-fa3502360286 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:34.058811 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-fc6dc7e0-c0d1-4ef9-9f6d-fa3502360286 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:34.059903 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-fc6dc7e0-c0d1-4ef9-9f6d-fa3502360286 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:34.060743 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-fc6dc7e0-c0d1-4ef9-9f6d-fa3502360286 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:34.118853 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-fc6dc7e0-c0d1-4ef9-9f6d-fa3502360286 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] 10.222.0.79 "GET /compute/v2.1/servers/f6852bd3-1574-4ae7-a78f-16f07931687b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083667 Jan 28 02:08:34.120335 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 204/416] 10.222.0.79 () {58 vars in 1301 bytes} [Fri Jan 28 02:08:34 2022] GET /compute/v2.1/servers/f6852bd3-1574-4ae7-a78f-16f07931687b/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:08:34.757185 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-cbc7460a-28c0-4b8f-805c-33eabd4ce12e tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:34.758714 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-cbc7460a-28c0-4b8f-805c-33eabd4ce12e tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: d5f49055-da38-486c-9f10-1658c64d46f5] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:34.775909 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-cbc7460a-28c0-4b8f-805c-33eabd4ce12e tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:34.779412 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-cbc7460a-28c0-4b8f-805c-33eabd4ce12e tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:34.781736 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-cbc7460a-28c0-4b8f-805c-33eabd4ce12e tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:34.785661 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-cbc7460a-28c0-4b8f-805c-33eabd4ce12e tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:35.007440 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-cc52e18c-d886-421f-a178-2f317bdd608b tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:35.008349 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-cc52e18c-d886-421f-a178-2f317bdd608b tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:35.022418 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-cc52e18c-d886-421f-a178-2f317bdd608b tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:35.025950 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-cc52e18c-d886-421f-a178-2f317bdd608b tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:35.029992 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-cc52e18c-d886-421f-a178-2f317bdd608b tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:35.031201 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-cc52e18c-d886-421f-a178-2f317bdd608b tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:35.453787 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-cbc7460a-28c0-4b8f-805c-33eabd4ce12e tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acab2a0c4a0e48909317791a3de85b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abe012ba65845329098e0e06c54b9c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:35.475035 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-cbc7460a-28c0-4b8f-805c-33eabd4ce12e tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "GET /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5" status: 200 len: 1723 microversion: 2.1 time: 0.723242 Jan 28 02:08:35.477863 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 213/417] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:08:34 2022] GET /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5 => generated 1723 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:08:35.495102 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-63d3c126-a281-4d4d-a0aa-4db59496bb5a tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:35.496285 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-63d3c126-a281-4d4d-a0aa-4db59496bb5a tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] [instance: f6852bd3-1574-4ae7-a78f-16f07931687b] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:35.502529 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-63d3c126-a281-4d4d-a0aa-4db59496bb5a tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:35.503235 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-63d3c126-a281-4d4d-a0aa-4db59496bb5a tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:35.504377 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-63d3c126-a281-4d4d-a0aa-4db59496bb5a tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:35.504952 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-63d3c126-a281-4d4d-a0aa-4db59496bb5a tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:35.562704 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-63d3c126-a281-4d4d-a0aa-4db59496bb5a tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] 10.222.0.79 "GET /compute/v2.1/servers/f6852bd3-1574-4ae7-a78f-16f07931687b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083185 Jan 28 02:08:35.563860 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 214/418] 10.222.0.79 () {58 vars in 1301 bytes} [Fri Jan 28 02:08:35 2022] GET /compute/v2.1/servers/f6852bd3-1574-4ae7-a78f-16f07931687b/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:08:35.589118 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-cc52e18c-d886-421f-a178-2f317bdd608b tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:35.602897 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-cc52e18c-d886-421f-a178-2f317bdd608b tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:35.605156 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-cc52e18c-d886-421f-a178-2f317bdd608b tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:35.606693 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-cc52e18c-d886-421f-a178-2f317bdd608b tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84" status: 200 len: 1739 microversion: 2.20 time: 0.603564 Jan 28 02:08:35.619158 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 205/419] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:08:35 2022] GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84 => generated 1739 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:08:36.494060 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-8fac1602-c94e-4d03-a749-762b888d2f08 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:36.494744 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-8fac1602-c94e-4d03-a749-762b888d2f08 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: d5f49055-da38-486c-9f10-1658c64d46f5] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:36.502379 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-8fac1602-c94e-4d03-a749-762b888d2f08 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:36.504938 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-8fac1602-c94e-4d03-a749-762b888d2f08 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:36.511548 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-8fac1602-c94e-4d03-a749-762b888d2f08 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:36.512011 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-8fac1602-c94e-4d03-a749-762b888d2f08 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:36.575029 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-e241890d-6e76-4fe7-a70a-761bf79d86e8 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:36.576421 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-e241890d-6e76-4fe7-a70a-761bf79d86e8 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] [instance: f6852bd3-1574-4ae7-a78f-16f07931687b] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:36.586021 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-e241890d-6e76-4fe7-a70a-761bf79d86e8 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:36.591166 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-e241890d-6e76-4fe7-a70a-761bf79d86e8 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:36.591166 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-e241890d-6e76-4fe7-a70a-761bf79d86e8 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:36.591166 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-e241890d-6e76-4fe7-a70a-761bf79d86e8 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:36.667983 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-e241890d-6e76-4fe7-a70a-761bf79d86e8 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] 10.222.0.79 "GET /compute/v2.1/servers/f6852bd3-1574-4ae7-a78f-16f07931687b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.097017 Jan 28 02:08:36.675560 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 206/420] 10.222.0.79 () {58 vars in 1301 bytes} [Fri Jan 28 02:08:36 2022] GET /compute/v2.1/servers/f6852bd3-1574-4ae7-a78f-16f07931687b/os-volume_attachments => generated 197 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:08:36.683383 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-fb9b79dc-51b9-46d3-bf85-1c1238fc1ebe tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:36.684781 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-fb9b79dc-51b9-46d3-bf85-1c1238fc1ebe tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:36.704547 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-fb9b79dc-51b9-46d3-bf85-1c1238fc1ebe tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:36.705350 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-fb9b79dc-51b9-46d3-bf85-1c1238fc1ebe tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:36.708131 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-fb9b79dc-51b9-46d3-bf85-1c1238fc1ebe tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:36.708804 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-fb9b79dc-51b9-46d3-bf85-1c1238fc1ebe tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:36.739432 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-8fac1602-c94e-4d03-a749-762b888d2f08 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acab2a0c4a0e48909317791a3de85b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abe012ba65845329098e0e06c54b9c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:36.753080 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-8fac1602-c94e-4d03-a749-762b888d2f08 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "GET /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5" status: 200 len: 1723 microversion: 2.1 time: 0.262679 Jan 28 02:08:36.756982 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 215/421] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:08:36 2022] GET /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5 => generated 1723 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:08:37.202177 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-fb9b79dc-51b9-46d3-bf85-1c1238fc1ebe tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:37.218154 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-fb9b79dc-51b9-46d3-bf85-1c1238fc1ebe tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:37.224144 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-fb9b79dc-51b9-46d3-bf85-1c1238fc1ebe tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:37.225717 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-fb9b79dc-51b9-46d3-bf85-1c1238fc1ebe tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84" status: 200 len: 1739 microversion: 2.20 time: 0.547771 Jan 28 02:08:37.226303 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 207/422] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:08:36 2022] GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84 => generated 1739 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:08:37.688856 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-a1b3e9ea-49e2-41a8-acde-dfb69090ad78 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:37.690429 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-a1b3e9ea-49e2-41a8-acde-dfb69090ad78 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] [instance: f6852bd3-1574-4ae7-a78f-16f07931687b] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:37.708266 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a1b3e9ea-49e2-41a8-acde-dfb69090ad78 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:37.708897 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a1b3e9ea-49e2-41a8-acde-dfb69090ad78 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:37.710336 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a1b3e9ea-49e2-41a8-acde-dfb69090ad78 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:37.710797 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a1b3e9ea-49e2-41a8-acde-dfb69090ad78 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:37.772342 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-0892ffd7-ac25-4b87-8004-741f80cd3283 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:37.775251 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-0892ffd7-ac25-4b87-8004-741f80cd3283 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: d5f49055-da38-486c-9f10-1658c64d46f5] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:37.789459 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-a1b3e9ea-49e2-41a8-acde-dfb69090ad78 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] 10.222.0.79 "GET /compute/v2.1/servers/f6852bd3-1574-4ae7-a78f-16f07931687b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.106730 Jan 28 02:08:37.793569 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 216/423] 10.222.0.79 () {58 vars in 1301 bytes} [Fri Jan 28 02:08:37 2022] GET /compute/v2.1/servers/f6852bd3-1574-4ae7-a78f-16f07931687b/os-volume_attachments => generated 197 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:08:37.795860 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-0892ffd7-ac25-4b87-8004-741f80cd3283 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:37.797835 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-0892ffd7-ac25-4b87-8004-741f80cd3283 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:37.803539 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-0892ffd7-ac25-4b87-8004-741f80cd3283 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:37.805311 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-0892ffd7-ac25-4b87-8004-741f80cd3283 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:38.007105 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-0892ffd7-ac25-4b87-8004-741f80cd3283 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acab2a0c4a0e48909317791a3de85b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abe012ba65845329098e0e06c54b9c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:38.019338 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-0892ffd7-ac25-4b87-8004-741f80cd3283 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "GET /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5" status: 200 len: 1723 microversion: 2.1 time: 0.251908 Jan 28 02:08:38.020682 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 208/424] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:08:37 2022] GET /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5 => generated 1723 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:08:38.244806 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-9c2def17-41e4-414a-bc10-a05288bd2198 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:38.250518 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-9c2def17-41e4-414a-bc10-a05288bd2198 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:38.253196 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-9c2def17-41e4-414a-bc10-a05288bd2198 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:38.254104 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-9c2def17-41e4-414a-bc10-a05288bd2198 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:38.255348 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-9c2def17-41e4-414a-bc10-a05288bd2198 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:38.256681 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-9c2def17-41e4-414a-bc10-a05288bd2198 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:38.430765 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-9c2def17-41e4-414a-bc10-a05288bd2198 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:38.440929 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-9c2def17-41e4-414a-bc10-a05288bd2198 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:38.442829 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-9c2def17-41e4-414a-bc10-a05288bd2198 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:38.444246 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-9c2def17-41e4-414a-bc10-a05288bd2198 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84" status: 200 len: 1739 microversion: 2.20 time: 0.203202 Jan 28 02:08:38.458388 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 217/425] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:08:38 2022] GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84 => generated 1739 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:08:38.807548 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-aec242ae-5021-4e5c-9177-df8b3d1ceef6 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:38.809320 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-aec242ae-5021-4e5c-9177-df8b3d1ceef6 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] [instance: f6852bd3-1574-4ae7-a78f-16f07931687b] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:38.816535 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-aec242ae-5021-4e5c-9177-df8b3d1ceef6 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:38.817350 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-aec242ae-5021-4e5c-9177-df8b3d1ceef6 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:38.817754 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-aec242ae-5021-4e5c-9177-df8b3d1ceef6 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:38.818182 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-aec242ae-5021-4e5c-9177-df8b3d1ceef6 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:38.914549 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-aec242ae-5021-4e5c-9177-df8b3d1ceef6 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] 10.222.0.79 "GET /compute/v2.1/servers/f6852bd3-1574-4ae7-a78f-16f07931687b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.114171 Jan 28 02:08:38.915284 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 209/426] 10.222.0.79 () {58 vars in 1301 bytes} [Fri Jan 28 02:08:38 2022] GET /compute/v2.1/servers/f6852bd3-1574-4ae7-a78f-16f07931687b/os-volume_attachments => generated 197 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:08:39.038010 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-45409eaa-d907-4f79-bbe5-6956f0fda5a8 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:39.038592 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-45409eaa-d907-4f79-bbe5-6956f0fda5a8 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: d5f49055-da38-486c-9f10-1658c64d46f5] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:39.048253 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-45409eaa-d907-4f79-bbe5-6956f0fda5a8 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:39.048710 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-45409eaa-d907-4f79-bbe5-6956f0fda5a8 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:39.049491 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-45409eaa-d907-4f79-bbe5-6956f0fda5a8 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:39.049921 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-45409eaa-d907-4f79-bbe5-6956f0fda5a8 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:39.290592 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-45409eaa-d907-4f79-bbe5-6956f0fda5a8 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acab2a0c4a0e48909317791a3de85b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abe012ba65845329098e0e06c54b9c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:39.299434 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-45409eaa-d907-4f79-bbe5-6956f0fda5a8 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "GET /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5" status: 200 len: 1723 microversion: 2.1 time: 0.265149 Jan 28 02:08:39.309351 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 218/427] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:08:39 2022] GET /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5 => generated 1723 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:08:39.471468 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-463d3ab3-4c70-481b-b0e9-d4e8b5822481 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:39.472301 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-463d3ab3-4c70-481b-b0e9-d4e8b5822481 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:39.479727 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-463d3ab3-4c70-481b-b0e9-d4e8b5822481 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:39.480445 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-463d3ab3-4c70-481b-b0e9-d4e8b5822481 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:39.483384 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-463d3ab3-4c70-481b-b0e9-d4e8b5822481 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:39.484008 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-463d3ab3-4c70-481b-b0e9-d4e8b5822481 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:39.647330 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-463d3ab3-4c70-481b-b0e9-d4e8b5822481 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:39.657340 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-463d3ab3-4c70-481b-b0e9-d4e8b5822481 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:39.659046 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-463d3ab3-4c70-481b-b0e9-d4e8b5822481 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:39.660354 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-463d3ab3-4c70-481b-b0e9-d4e8b5822481 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84" status: 200 len: 1739 microversion: 2.20 time: 0.197795 Jan 28 02:08:39.661102 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 210/428] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:08:39 2022] GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84 => generated 1739 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 02:08:39.989137 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-10643b5f-7a22-4af3-a00d-a8bb1c0180d6 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:39.989137 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-10643b5f-7a22-4af3-a00d-a8bb1c0180d6 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] [instance: f6852bd3-1574-4ae7-a78f-16f07931687b] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:39.989137 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-10643b5f-7a22-4af3-a00d-a8bb1c0180d6 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:39.989137 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-10643b5f-7a22-4af3-a00d-a8bb1c0180d6 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:39.989647 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-10643b5f-7a22-4af3-a00d-a8bb1c0180d6 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:39.989647 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-10643b5f-7a22-4af3-a00d-a8bb1c0180d6 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:39.989647 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-10643b5f-7a22-4af3-a00d-a8bb1c0180d6 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] 10.222.0.79 "GET /compute/v2.1/servers/f6852bd3-1574-4ae7-a78f-16f07931687b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043191 Jan 28 02:08:39.989647 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 219/429] 10.222.0.79 () {58 vars in 1301 bytes} [Fri Jan 28 02:08:39 2022] GET /compute/v2.1/servers/f6852bd3-1574-4ae7-a78f-16f07931687b/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:08:40.142563 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-0512a265-3d06-450f-bb2b-a13ec04904e1 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:08:40.142563 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-0512a265-3d06-450f-bb2b-a13ec04904e1 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] [instance: ec5e47ac-761b-467f-958c-516a9f8bc3e6] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:40.155449 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-0512a265-3d06-450f-bb2b-a13ec04904e1 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:40.156480 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-0512a265-3d06-450f-bb2b-a13ec04904e1 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:40.157425 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-0512a265-3d06-450f-bb2b-a13ec04904e1 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:40.165697 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-0512a265-3d06-450f-bb2b-a13ec04904e1 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:40.206147 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.objects.instance [None req-0512a265-3d06-450f-bb2b-a13ec04904e1 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lazy-loading 'flavor' on Instance uuid ec5e47ac-761b-467f-958c-516a9f8bc3e6 {{(pid=116374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jan 28 02:08:40.317893 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-b4853cd8-99b9-415e-a820-232764b3494b tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:40.318671 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-b4853cd8-99b9-415e-a820-232764b3494b tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: d5f49055-da38-486c-9f10-1658c64d46f5] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:40.324774 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b4853cd8-99b9-415e-a820-232764b3494b tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:40.325215 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b4853cd8-99b9-415e-a820-232764b3494b tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:40.325976 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b4853cd8-99b9-415e-a820-232764b3494b tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:40.326468 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b4853cd8-99b9-415e-a820-232764b3494b tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:40.908822 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-b4853cd8-99b9-415e-a820-232764b3494b tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acab2a0c4a0e48909317791a3de85b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abe012ba65845329098e0e06c54b9c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:40.931760 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-b4853cd8-99b9-415e-a820-232764b3494b tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "GET /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5" status: 200 len: 1723 microversion: 2.1 time: 0.615072 Jan 28 02:08:40.933084 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 220/430] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:08:40 2022] GET /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5 => generated 1723 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:08:40.956316 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-5db3c691-cc77-4576-a399-7aef0ec10f51 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:40.957770 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-5db3c691-cc77-4576-a399-7aef0ec10f51 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:40.974867 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-5db3c691-cc77-4576-a399-7aef0ec10f51 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:40.974867 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-5db3c691-cc77-4576-a399-7aef0ec10f51 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:40.975120 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-5db3c691-cc77-4576-a399-7aef0ec10f51 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:40.977597 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-5db3c691-cc77-4576-a399-7aef0ec10f51 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:41.234490 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-0512a265-3d06-450f-bb2b-a13ec04904e1 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] 10.222.0.79 "POST /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6/action" status: 200 len: 32 microversion: 2.1 time: 1.105091 Jan 28 02:08:41.238576 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 211/431] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Jan 28 02:08:40 2022] POST /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6/action => generated 32 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 02:08:41.261823 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-e3730e49-144f-4a46-a65a-3810f0ec05c6 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:41.261823 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-e3730e49-144f-4a46-a65a-3810f0ec05c6 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] [instance: f6852bd3-1574-4ae7-a78f-16f07931687b] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:41.268661 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-e3730e49-144f-4a46-a65a-3810f0ec05c6 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:41.269628 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-e3730e49-144f-4a46-a65a-3810f0ec05c6 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:41.270580 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-e3730e49-144f-4a46-a65a-3810f0ec05c6 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:41.271167 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-e3730e49-144f-4a46-a65a-3810f0ec05c6 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:41.294738 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-5db3c691-cc77-4576-a399-7aef0ec10f51 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:41.311591 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-5db3c691-cc77-4576-a399-7aef0ec10f51 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:41.313633 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-5db3c691-cc77-4576-a399-7aef0ec10f51 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:41.315681 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-5db3c691-cc77-4576-a399-7aef0ec10f51 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84" status: 200 len: 1739 microversion: 2.20 time: 0.376132 Jan 28 02:08:41.316156 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-e3730e49-144f-4a46-a65a-3810f0ec05c6 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] 10.222.0.79 "GET /compute/v2.1/servers/f6852bd3-1574-4ae7-a78f-16f07931687b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.075835 Jan 28 02:08:41.316741 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 221/432] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:08:40 2022] GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84 => generated 1739 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:08:41.321334 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 212/433] 10.222.0.79 () {58 vars in 1301 bytes} [Fri Jan 28 02:08:41 2022] GET /compute/v2.1/servers/f6852bd3-1574-4ae7-a78f-16f07931687b/os-volume_attachments => generated 25 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 02:08:41.321991 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-4ac7ace1-9421-4ba5-8ca2-ae0ed9ffcec6 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:41.322595 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-4ac7ace1-9421-4ba5-8ca2-ae0ed9ffcec6 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] [instance: ec5e47ac-761b-467f-958c-516a9f8bc3e6] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:41.329411 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-4ac7ace1-9421-4ba5-8ca2-ae0ed9ffcec6 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:41.332929 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-4ac7ace1-9421-4ba5-8ca2-ae0ed9ffcec6 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:41.332929 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-4ac7ace1-9421-4ba5-8ca2-ae0ed9ffcec6 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:41.332929 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-4ac7ace1-9421-4ba5-8ca2-ae0ed9ffcec6 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:41.546171 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-2761f023-5ab2-48d3-af35-36080086c490 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1910883643", "imageRef": "04805ce8-b0a0-41b2-b614-bfb5b752cc5d", "flavorRef": "452", "networks": [{"uuid": "a1afa762-f2ce-40be-8faa-e9c2b4144812"}]}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:08:41.559866 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-4ac7ace1-9421-4ba5-8ca2-ae0ed9ffcec6 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd7039b8f074a13b2030a2bb7aaff94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc19a0f9c33f47f1b504bebbb0b2c931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:41.575090 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-4ac7ace1-9421-4ba5-8ca2-ae0ed9ffcec6 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] 10.222.0.79 "GET /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6" status: 200 len: 1567 microversion: 2.1 time: 0.256985 Jan 28 02:08:41.588410 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 213/434] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:08:41 2022] GET /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6 => generated 1567 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:08:41.950852 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-fa8b279e-41f7-4cfa-bcbd-5b9cf6c13896 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:41.952201 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-fa8b279e-41f7-4cfa-bcbd-5b9cf6c13896 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: d5f49055-da38-486c-9f10-1658c64d46f5] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:41.965353 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-fa8b279e-41f7-4cfa-bcbd-5b9cf6c13896 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:41.966141 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-fa8b279e-41f7-4cfa-bcbd-5b9cf6c13896 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:41.967170 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-fa8b279e-41f7-4cfa-bcbd-5b9cf6c13896 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:41.969689 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-fa8b279e-41f7-4cfa-bcbd-5b9cf6c13896 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:42.124405 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-fa8b279e-41f7-4cfa-bcbd-5b9cf6c13896 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acab2a0c4a0e48909317791a3de85b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abe012ba65845329098e0e06c54b9c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:42.151480 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-fa8b279e-41f7-4cfa-bcbd-5b9cf6c13896 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "GET /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5" status: 200 len: 1723 microversion: 2.1 time: 0.203650 Jan 28 02:08:42.152584 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 214/435] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:08:41 2022] GET /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5 => generated 1723 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:08:42.336770 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-2d1fb92d-80b9-4d5d-80d4-bfae7fbb48f7 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:42.337468 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-2d1fb92d-80b9-4d5d-80d4-bfae7fbb48f7 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:42.344686 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-2d1fb92d-80b9-4d5d-80d4-bfae7fbb48f7 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:42.345467 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-2d1fb92d-80b9-4d5d-80d4-bfae7fbb48f7 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:42.346300 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-2d1fb92d-80b9-4d5d-80d4-bfae7fbb48f7 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:42.346915 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-2d1fb92d-80b9-4d5d-80d4-bfae7fbb48f7 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:42.536634 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-2d1fb92d-80b9-4d5d-80d4-bfae7fbb48f7 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:42.545859 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-2d1fb92d-80b9-4d5d-80d4-bfae7fbb48f7 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:42.547493 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-2d1fb92d-80b9-4d5d-80d4-bfae7fbb48f7 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:42.548941 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-2d1fb92d-80b9-4d5d-80d4-bfae7fbb48f7 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84" status: 200 len: 1739 microversion: 2.20 time: 0.216930 Jan 28 02:08:42.549495 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 215/436] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:08:42 2022] GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84 => generated 1739 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:08:42.598340 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-20a79bf5-daa8-4350-b542-06918c9c7b54 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:42.599377 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-20a79bf5-daa8-4350-b542-06918c9c7b54 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] [instance: ec5e47ac-761b-467f-958c-516a9f8bc3e6] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:42.606869 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-20a79bf5-daa8-4350-b542-06918c9c7b54 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:42.607319 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-20a79bf5-daa8-4350-b542-06918c9c7b54 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:42.608993 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-20a79bf5-daa8-4350-b542-06918c9c7b54 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:42.609709 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-20a79bf5-daa8-4350-b542-06918c9c7b54 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:42.766198 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-20a79bf5-daa8-4350-b542-06918c9c7b54 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd7039b8f074a13b2030a2bb7aaff94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc19a0f9c33f47f1b504bebbb0b2c931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:42.774203 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-20a79bf5-daa8-4350-b542-06918c9c7b54 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] 10.222.0.79 "GET /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6" status: 200 len: 1567 microversion: 2.1 time: 0.182709 Jan 28 02:08:42.774784 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 216/437] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:08:42 2022] GET /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6 => generated 1567 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:08:43.171371 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-6e298285-5837-4cbe-a23b-41e5b7f834fd tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:43.178129 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-6e298285-5837-4cbe-a23b-41e5b7f834fd tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: d5f49055-da38-486c-9f10-1658c64d46f5] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:43.184817 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-6e298285-5837-4cbe-a23b-41e5b7f834fd tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:43.186311 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-6e298285-5837-4cbe-a23b-41e5b7f834fd tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:43.187286 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-6e298285-5837-4cbe-a23b-41e5b7f834fd tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:43.188042 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-6e298285-5837-4cbe-a23b-41e5b7f834fd tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:43.347158 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-6e298285-5837-4cbe-a23b-41e5b7f834fd tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acab2a0c4a0e48909317791a3de85b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abe012ba65845329098e0e06c54b9c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:43.361059 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-6e298285-5837-4cbe-a23b-41e5b7f834fd tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "GET /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5" status: 200 len: 1723 microversion: 2.1 time: 0.194554 Jan 28 02:08:43.361980 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 217/438] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:08:43 2022] GET /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5 => generated 1723 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:08:43.571349 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-64ac0605-7a93-4b89-a02d-e70467f06a1d tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:43.572815 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-64ac0605-7a93-4b89-a02d-e70467f06a1d tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:43.582271 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-64ac0605-7a93-4b89-a02d-e70467f06a1d tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:43.582993 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-64ac0605-7a93-4b89-a02d-e70467f06a1d tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:43.583935 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-64ac0605-7a93-4b89-a02d-e70467f06a1d tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:43.584539 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-64ac0605-7a93-4b89-a02d-e70467f06a1d tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:43.764840 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-64ac0605-7a93-4b89-a02d-e70467f06a1d tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:43.777393 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-64ac0605-7a93-4b89-a02d-e70467f06a1d tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:43.778889 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-64ac0605-7a93-4b89-a02d-e70467f06a1d tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:43.781186 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-64ac0605-7a93-4b89-a02d-e70467f06a1d tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84" status: 200 len: 1739 microversion: 2.20 time: 0.217261 Jan 28 02:08:43.785617 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 218/439] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:08:43 2022] GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84 => generated 1739 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 02:08:43.791933 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-b2c3c28f-151c-4c22-8ad2-84ed2761019c tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:43.792667 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-b2c3c28f-151c-4c22-8ad2-84ed2761019c tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] [instance: ec5e47ac-761b-467f-958c-516a9f8bc3e6] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:43.800484 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-b2c3c28f-151c-4c22-8ad2-84ed2761019c tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:43.801082 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-b2c3c28f-151c-4c22-8ad2-84ed2761019c tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:43.801931 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-b2c3c28f-151c-4c22-8ad2-84ed2761019c tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:43.802761 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-b2c3c28f-151c-4c22-8ad2-84ed2761019c tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:43.951829 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-b2c3c28f-151c-4c22-8ad2-84ed2761019c tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd7039b8f074a13b2030a2bb7aaff94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc19a0f9c33f47f1b504bebbb0b2c931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:43.965340 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-b2c3c28f-151c-4c22-8ad2-84ed2761019c tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] 10.222.0.79 "GET /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6" status: 200 len: 1567 microversion: 2.1 time: 0.176876 Jan 28 02:08:43.965922 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 219/440] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:08:43 2022] GET /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6 => generated 1567 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:08:44.379072 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-37916f53-df08-4943-a305-3446c5968817 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:44.379789 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-37916f53-df08-4943-a305-3446c5968817 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: d5f49055-da38-486c-9f10-1658c64d46f5] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:44.385879 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-37916f53-df08-4943-a305-3446c5968817 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:44.386323 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-37916f53-df08-4943-a305-3446c5968817 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:44.387143 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-37916f53-df08-4943-a305-3446c5968817 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:44.387569 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-37916f53-df08-4943-a305-3446c5968817 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:44.586524 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-37916f53-df08-4943-a305-3446c5968817 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acab2a0c4a0e48909317791a3de85b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abe012ba65845329098e0e06c54b9c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:44.586524 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-37916f53-df08-4943-a305-3446c5968817 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "GET /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5" status: 200 len: 1723 microversion: 2.1 time: 0.198583 Jan 28 02:08:44.586524 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 220/441] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:08:44 2022] GET /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5 => generated 1723 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:08:44.799301 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-78bddfba-aa90-40da-a0a6-38098b3ce41b tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:44.805306 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-78bddfba-aa90-40da-a0a6-38098b3ce41b tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:44.812657 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-78bddfba-aa90-40da-a0a6-38098b3ce41b tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:44.813045 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-78bddfba-aa90-40da-a0a6-38098b3ce41b tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:44.813817 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-78bddfba-aa90-40da-a0a6-38098b3ce41b tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:44.814249 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-78bddfba-aa90-40da-a0a6-38098b3ce41b tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:45.029568 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-78bddfba-aa90-40da-a0a6-38098b3ce41b tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:45.037309 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-78bddfba-aa90-40da-a0a6-38098b3ce41b tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:45.038827 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-78bddfba-aa90-40da-a0a6-38098b3ce41b tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:45.039995 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-78bddfba-aa90-40da-a0a6-38098b3ce41b tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84" status: 200 len: 1739 microversion: 2.20 time: 0.244673 Jan 28 02:08:45.040553 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 221/442] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:08:44 2022] GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84 => generated 1739 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 02:08:45.044773 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-414ce121-5a54-443d-875a-7e6e3173b57f tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:45.045918 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-414ce121-5a54-443d-875a-7e6e3173b57f tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] [instance: ec5e47ac-761b-467f-958c-516a9f8bc3e6] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:45.051416 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-414ce121-5a54-443d-875a-7e6e3173b57f tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:45.052511 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-414ce121-5a54-443d-875a-7e6e3173b57f tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:45.052671 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-414ce121-5a54-443d-875a-7e6e3173b57f tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:45.053108 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-414ce121-5a54-443d-875a-7e6e3173b57f tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:45.187093 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-414ce121-5a54-443d-875a-7e6e3173b57f tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd7039b8f074a13b2030a2bb7aaff94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc19a0f9c33f47f1b504bebbb0b2c931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:45.196919 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-414ce121-5a54-443d-875a-7e6e3173b57f tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] 10.222.0.79 "GET /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6" status: 200 len: 1567 microversion: 2.1 time: 0.155173 Jan 28 02:08:45.206338 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 222/443] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:08:45 2022] GET /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6 => generated 1567 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:08:45.601728 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-da1e8ea0-64b6-42d4-8ba0-6e20b909ba89 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:45.602652 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-da1e8ea0-64b6-42d4-8ba0-6e20b909ba89 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: d5f49055-da38-486c-9f10-1658c64d46f5] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:45.609779 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-da1e8ea0-64b6-42d4-8ba0-6e20b909ba89 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:45.610274 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-da1e8ea0-64b6-42d4-8ba0-6e20b909ba89 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:45.611053 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-da1e8ea0-64b6-42d4-8ba0-6e20b909ba89 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:45.611544 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-da1e8ea0-64b6-42d4-8ba0-6e20b909ba89 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:45.741693 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-da1e8ea0-64b6-42d4-8ba0-6e20b909ba89 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acab2a0c4a0e48909317791a3de85b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abe012ba65845329098e0e06c54b9c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:45.750810 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-da1e8ea0-64b6-42d4-8ba0-6e20b909ba89 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "GET /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5" status: 200 len: 1723 microversion: 2.1 time: 0.152572 Jan 28 02:08:45.751679 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 223/444] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:08:45 2022] GET /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:08:46.058796 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-78c78fa5-3d0f-481d-aa53-a575499ec22a tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:46.059401 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-78c78fa5-3d0f-481d-aa53-a575499ec22a tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:46.066664 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-78c78fa5-3d0f-481d-aa53-a575499ec22a tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:46.066664 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-78c78fa5-3d0f-481d-aa53-a575499ec22a tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:46.067359 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-78c78fa5-3d0f-481d-aa53-a575499ec22a tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:46.067806 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-78c78fa5-3d0f-481d-aa53-a575499ec22a tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:46.192610 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-78c78fa5-3d0f-481d-aa53-a575499ec22a tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:46.200915 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-78c78fa5-3d0f-481d-aa53-a575499ec22a tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:46.202428 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-78c78fa5-3d0f-481d-aa53-a575499ec22a tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:46.203594 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-78c78fa5-3d0f-481d-aa53-a575499ec22a tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84" status: 200 len: 1739 microversion: 2.20 time: 0.148491 Jan 28 02:08:46.204230 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 224/445] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:08:46 2022] GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84 => generated 1739 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 02:08:46.213139 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-ea365cea-77a3-46be-83ef-a2d362434869 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:46.213859 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-ea365cea-77a3-46be-83ef-a2d362434869 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] [instance: ec5e47ac-761b-467f-958c-516a9f8bc3e6] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:46.221919 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-ea365cea-77a3-46be-83ef-a2d362434869 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:46.222390 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-ea365cea-77a3-46be-83ef-a2d362434869 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:46.223226 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-ea365cea-77a3-46be-83ef-a2d362434869 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:46.223664 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-ea365cea-77a3-46be-83ef-a2d362434869 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:46.350725 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-ea365cea-77a3-46be-83ef-a2d362434869 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd7039b8f074a13b2030a2bb7aaff94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc19a0f9c33f47f1b504bebbb0b2c931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:46.360668 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-ea365cea-77a3-46be-83ef-a2d362434869 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] 10.222.0.79 "GET /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6" status: 200 len: 1567 microversion: 2.1 time: 0.151182 Jan 28 02:08:46.362160 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 225/446] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:08:46 2022] GET /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6 => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:08:46.767386 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-b14ff041-9fc5-4084-9208-5972166f5e52 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:46.768032 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-b14ff041-9fc5-4084-9208-5972166f5e52 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: d5f49055-da38-486c-9f10-1658c64d46f5] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:46.774152 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-b14ff041-9fc5-4084-9208-5972166f5e52 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:46.774520 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-b14ff041-9fc5-4084-9208-5972166f5e52 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:46.775326 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-b14ff041-9fc5-4084-9208-5972166f5e52 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:46.775758 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-b14ff041-9fc5-4084-9208-5972166f5e52 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:46.909507 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-b14ff041-9fc5-4084-9208-5972166f5e52 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acab2a0c4a0e48909317791a3de85b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abe012ba65845329098e0e06c54b9c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:46.918644 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-b14ff041-9fc5-4084-9208-5972166f5e52 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "GET /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5" status: 200 len: 1723 microversion: 2.1 time: 0.154953 Jan 28 02:08:46.919298 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 226/447] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:08:46 2022] GET /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:08:47.223418 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-ad8f8400-8c84-47ec-bbf2-0bf0420f339d tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:47.224458 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-ad8f8400-8c84-47ec-bbf2-0bf0420f339d tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:47.230844 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-ad8f8400-8c84-47ec-bbf2-0bf0420f339d tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:47.231420 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-ad8f8400-8c84-47ec-bbf2-0bf0420f339d tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:47.232467 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-ad8f8400-8c84-47ec-bbf2-0bf0420f339d tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:47.232973 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-ad8f8400-8c84-47ec-bbf2-0bf0420f339d tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:47.293755 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.network.neutron [None req-2761f023-5ab2-48d3-af35-36080086c490 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] validate_networks() for [('a1afa762-f2ce-40be-8faa-e9c2b4144812', None, None, None, None, None)] {{(pid=116375) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Jan 28 02:08:47.473410 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-ad8f8400-8c84-47ec-bbf2-0bf0420f339d tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:47.483490 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-ad8f8400-8c84-47ec-bbf2-0bf0420f339d tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:47.486666 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-ad8f8400-8c84-47ec-bbf2-0bf0420f339d tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:47.489161 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-ad8f8400-8c84-47ec-bbf2-0bf0420f339d tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84" status: 200 len: 1739 microversion: 2.20 time: 0.269639 Jan 28 02:08:47.504171 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 227/448] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:08:47 2022] GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84 => generated 1739 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 02:08:47.511259 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-af66c931-ed9b-4d72-b9c6-fc986b9cfaef tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:47.511991 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-af66c931-ed9b-4d72-b9c6-fc986b9cfaef tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] [instance: ec5e47ac-761b-467f-958c-516a9f8bc3e6] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:47.520304 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-af66c931-ed9b-4d72-b9c6-fc986b9cfaef tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:47.520989 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-af66c931-ed9b-4d72-b9c6-fc986b9cfaef tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:47.521918 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-af66c931-ed9b-4d72-b9c6-fc986b9cfaef tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:47.522530 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-af66c931-ed9b-4d72-b9c6-fc986b9cfaef tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:48.099813 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-af66c931-ed9b-4d72-b9c6-fc986b9cfaef tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd7039b8f074a13b2030a2bb7aaff94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc19a0f9c33f47f1b504bebbb0b2c931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:48.108263 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-af66c931-ed9b-4d72-b9c6-fc986b9cfaef tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] 10.222.0.79 "GET /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6" status: 200 len: 1567 microversion: 2.1 time: 0.602301 Jan 28 02:08:48.118901 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 228/449] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:08:47 2022] GET /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6 => generated 1567 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:08:48.127474 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-dfc2fefe-77cb-4f68-8c33-ef2c35b3c1d2 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:48.128507 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-dfc2fefe-77cb-4f68-8c33-ef2c35b3c1d2 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: d5f49055-da38-486c-9f10-1658c64d46f5] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:48.139748 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-dfc2fefe-77cb-4f68-8c33-ef2c35b3c1d2 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:48.141470 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-dfc2fefe-77cb-4f68-8c33-ef2c35b3c1d2 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:48.142478 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-dfc2fefe-77cb-4f68-8c33-ef2c35b3c1d2 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:48.143071 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-dfc2fefe-77cb-4f68-8c33-ef2c35b3c1d2 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:48.246263 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.virt.hardware [None req-2761f023-5ab2-48d3-af35-36080086c490 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Flavor limits 0:0:0 {{(pid=116375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 02:08:48.247045 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.virt.hardware [None req-2761f023-5ab2-48d3-af35-36080086c490 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Image limits 0:0:0 {{(pid=116375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 02:08:48.248308 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.virt.hardware [None req-2761f023-5ab2-48d3-af35-36080086c490 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Flavor pref 0:0:0 {{(pid=116375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 02:08:48.248729 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.virt.hardware [None req-2761f023-5ab2-48d3-af35-36080086c490 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Image pref 0:0:0 {{(pid=116375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 02:08:48.249142 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.virt.hardware [None req-2761f023-5ab2-48d3-af35-36080086c490 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 02:08:48.261166 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2761f023-5ab2-48d3-af35-36080086c490 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:48.266287 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2761f023-5ab2-48d3-af35-36080086c490 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:48.266287 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2761f023-5ab2-48d3-af35-36080086c490 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:48.266287 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2761f023-5ab2-48d3-af35-36080086c490 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:48.283880 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.quota [None req-2761f023-5ab2-48d3-af35-36080086c490 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Getting quotas for project 2b66ddee4c864aae90b738695dffbeb9. Resources: {'ram', 'cores', 'instances'} {{(pid=116375) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 02:08:48.288554 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.quota [None req-2761f023-5ab2-48d3-af35-36080086c490 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Getting quotas for user b019715a14074e059730965913694e52 and project 2b66ddee4c864aae90b738695dffbeb9. Resources: {'ram', 'cores', 'instances'} {{(pid=116375) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 02:08:48.301035 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-2761f023-5ab2-48d3-af35-36080086c490 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Going to run 1 instances... {{(pid=116375) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 02:08:48.303665 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-2761f023-5ab2-48d3-af35-36080086c490 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] [instance: 96b38440-c5bd-4838-bd1b-46312012607e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='04805ce8-b0a0-41b2-b614-bfb5b752cc5d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116375) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 02:08:48.336812 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-dfc2fefe-77cb-4f68-8c33-ef2c35b3c1d2 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acab2a0c4a0e48909317791a3de85b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abe012ba65845329098e0e06c54b9c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:48.347544 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-dfc2fefe-77cb-4f68-8c33-ef2c35b3c1d2 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "GET /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5" status: 200 len: 1723 microversion: 2.1 time: 0.227238 Jan 28 02:08:48.348174 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 229/450] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:08:48 2022] GET /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5 => generated 1723 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:08:48.454989 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-2761f023-5ab2-48d3-af35-36080086c490 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 6.914828 Jan 28 02:08:48.460996 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 222/451] 10.222.0.79 () {60 vars in 1146 bytes} [Fri Jan 28 02:08:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 6921 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jan 28 02:08:48.465712 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-9f0c4887-3b4c-4468-9869-07191041f68a tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:48.466324 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-9f0c4887-3b4c-4468-9869-07191041f68a tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] [instance: 96b38440-c5bd-4838-bd1b-46312012607e] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:48.506768 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-29825778-769f-46f7-9af3-cb8551bc7778 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:48.507678 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-29825778-769f-46f7-9af3-cb8551bc7778 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:48.517248 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-29825778-769f-46f7-9af3-cb8551bc7778 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:48.518090 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-29825778-769f-46f7-9af3-cb8551bc7778 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:48.519412 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-29825778-769f-46f7-9af3-cb8551bc7778 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:48.520013 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-29825778-769f-46f7-9af3-cb8551bc7778 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:48.527318 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-9f0c4887-3b4c-4468-9869-07191041f68a tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b019715a14074e059730965913694e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b66ddee4c864aae90b738695dffbeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:48.545542 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-9f0c4887-3b4c-4468-9869-07191041f68a tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] 10.222.0.79 "GET /compute/v2.1/servers/96b38440-c5bd-4838-bd1b-46312012607e" status: 200 len: 1218 microversion: 2.1 time: 0.083504 Jan 28 02:08:48.556899 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 230/452] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:08:48 2022] GET /compute/v2.1/servers/96b38440-c5bd-4838-bd1b-46312012607e => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:08:48.691261 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-29825778-769f-46f7-9af3-cb8551bc7778 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:48.700008 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-29825778-769f-46f7-9af3-cb8551bc7778 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:48.701933 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-29825778-769f-46f7-9af3-cb8551bc7778 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:48.704346 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-29825778-769f-46f7-9af3-cb8551bc7778 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84" status: 200 len: 1739 microversion: 2.20 time: 0.201136 Jan 28 02:08:48.715673 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 223/453] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:08:48 2022] GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84 => generated 1739 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 02:08:49.126154 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-9c65be86-6bd5-4731-a21c-c6a7c16805aa tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:49.127470 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-9c65be86-6bd5-4731-a21c-c6a7c16805aa tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] [instance: ec5e47ac-761b-467f-958c-516a9f8bc3e6] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:49.146059 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-9c65be86-6bd5-4731-a21c-c6a7c16805aa tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:49.146859 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-9c65be86-6bd5-4731-a21c-c6a7c16805aa tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:49.148776 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-9c65be86-6bd5-4731-a21c-c6a7c16805aa tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:49.149435 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-9c65be86-6bd5-4731-a21c-c6a7c16805aa tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:49.294070 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-9c65be86-6bd5-4731-a21c-c6a7c16805aa tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd7039b8f074a13b2030a2bb7aaff94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc19a0f9c33f47f1b504bebbb0b2c931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:49.303622 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-9c65be86-6bd5-4731-a21c-c6a7c16805aa tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] 10.222.0.79 "GET /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6" status: 200 len: 1567 microversion: 2.1 time: 0.181945 Jan 28 02:08:49.304521 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 231/454] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:08:49 2022] GET /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6 => generated 1567 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:08:49.364473 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-7757f875-a02d-430b-af1e-ac31a7f2cd7e tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:49.365686 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-7757f875-a02d-430b-af1e-ac31a7f2cd7e tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: d5f49055-da38-486c-9f10-1658c64d46f5] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:49.372165 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-7757f875-a02d-430b-af1e-ac31a7f2cd7e tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:49.372615 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-7757f875-a02d-430b-af1e-ac31a7f2cd7e tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:49.373560 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-7757f875-a02d-430b-af1e-ac31a7f2cd7e tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:49.373930 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-7757f875-a02d-430b-af1e-ac31a7f2cd7e tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:49.514307 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-7757f875-a02d-430b-af1e-ac31a7f2cd7e tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acab2a0c4a0e48909317791a3de85b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abe012ba65845329098e0e06c54b9c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:49.525812 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-7757f875-a02d-430b-af1e-ac31a7f2cd7e tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "GET /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5" status: 200 len: 1723 microversion: 2.1 time: 0.164830 Jan 28 02:08:49.526317 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 224/455] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:08:49 2022] GET /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:08:49.563083 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-fa2314a5-795d-45e0-b150-474bf678c0bd tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:49.564094 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-fa2314a5-795d-45e0-b150-474bf678c0bd tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] [instance: 96b38440-c5bd-4838-bd1b-46312012607e] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:49.573427 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-fa2314a5-795d-45e0-b150-474bf678c0bd tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:49.573872 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-fa2314a5-795d-45e0-b150-474bf678c0bd tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:49.574652 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-fa2314a5-795d-45e0-b150-474bf678c0bd tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:49.575077 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-fa2314a5-795d-45e0-b150-474bf678c0bd tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:49.694730 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-fa2314a5-795d-45e0-b150-474bf678c0bd tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b019715a14074e059730965913694e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b66ddee4c864aae90b738695dffbeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:49.702798 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-fa2314a5-795d-45e0-b150-474bf678c0bd tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] 10.222.0.79 "GET /compute/v2.1/servers/96b38440-c5bd-4838-bd1b-46312012607e" status: 200 len: 1222 microversion: 2.1 time: 0.143548 Jan 28 02:08:49.717553 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 232/456] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:08:49 2022] GET /compute/v2.1/servers/96b38440-c5bd-4838-bd1b-46312012607e => generated 1222 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:08:49.742474 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-0779e5af-3b10-4e81-bb7e-727ad319fd44 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:49.743085 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-0779e5af-3b10-4e81-bb7e-727ad319fd44 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:49.760652 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-0779e5af-3b10-4e81-bb7e-727ad319fd44 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:49.761106 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-0779e5af-3b10-4e81-bb7e-727ad319fd44 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:49.761889 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-0779e5af-3b10-4e81-bb7e-727ad319fd44 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:49.762322 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-0779e5af-3b10-4e81-bb7e-727ad319fd44 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:49.902040 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-0779e5af-3b10-4e81-bb7e-727ad319fd44 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:49.910599 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-0779e5af-3b10-4e81-bb7e-727ad319fd44 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:49.912110 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-0779e5af-3b10-4e81-bb7e-727ad319fd44 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:49.913255 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-0779e5af-3b10-4e81-bb7e-727ad319fd44 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84" status: 200 len: 1739 microversion: 2.20 time: 0.174546 Jan 28 02:08:49.913810 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 225/457] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:08:49 2022] GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84 => generated 1739 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:08:50.321444 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-78f8ab77-9be2-4b8d-b430-61f22b471566 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:50.322044 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-78f8ab77-9be2-4b8d-b430-61f22b471566 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] [instance: ec5e47ac-761b-467f-958c-516a9f8bc3e6] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:50.332583 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-78f8ab77-9be2-4b8d-b430-61f22b471566 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:50.338044 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-78f8ab77-9be2-4b8d-b430-61f22b471566 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:50.338044 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-78f8ab77-9be2-4b8d-b430-61f22b471566 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:50.338044 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-78f8ab77-9be2-4b8d-b430-61f22b471566 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:50.462813 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-78f8ab77-9be2-4b8d-b430-61f22b471566 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd7039b8f074a13b2030a2bb7aaff94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc19a0f9c33f47f1b504bebbb0b2c931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:50.473243 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-78f8ab77-9be2-4b8d-b430-61f22b471566 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] 10.222.0.79 "GET /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6" status: 200 len: 1567 microversion: 2.1 time: 0.155211 Jan 28 02:08:50.482341 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 233/458] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:08:50 2022] GET /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6 => generated 1567 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:08:50.548614 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-c3fbb0ae-543d-4a74-ab61-34ccba388afe tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:50.549877 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-c3fbb0ae-543d-4a74-ab61-34ccba388afe tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: d5f49055-da38-486c-9f10-1658c64d46f5] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:50.556246 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c3fbb0ae-543d-4a74-ab61-34ccba388afe tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:50.556907 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c3fbb0ae-543d-4a74-ab61-34ccba388afe tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:50.557747 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c3fbb0ae-543d-4a74-ab61-34ccba388afe tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:50.558187 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c3fbb0ae-543d-4a74-ab61-34ccba388afe tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:50.702045 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-c3fbb0ae-543d-4a74-ab61-34ccba388afe tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acab2a0c4a0e48909317791a3de85b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abe012ba65845329098e0e06c54b9c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:50.712549 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-c3fbb0ae-543d-4a74-ab61-34ccba388afe tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "GET /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5" status: 200 len: 1723 microversion: 2.1 time: 0.168103 Jan 28 02:08:50.713341 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 226/459] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:08:50 2022] GET /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5 => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:08:50.747508 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-3414a276-f614-4f7e-8e62-13025166c32b tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:50.748436 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-3414a276-f614-4f7e-8e62-13025166c32b tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] [instance: 96b38440-c5bd-4838-bd1b-46312012607e] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:50.763145 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-3414a276-f614-4f7e-8e62-13025166c32b tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:50.764477 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-3414a276-f614-4f7e-8e62-13025166c32b tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:50.764900 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-3414a276-f614-4f7e-8e62-13025166c32b tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:50.765526 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-3414a276-f614-4f7e-8e62-13025166c32b tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:50.834602 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-3414a276-f614-4f7e-8e62-13025166c32b tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b019715a14074e059730965913694e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b66ddee4c864aae90b738695dffbeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:50.846043 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-3414a276-f614-4f7e-8e62-13025166c32b tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] 10.222.0.79 "GET /compute/v2.1/servers/96b38440-c5bd-4838-bd1b-46312012607e" status: 200 len: 1222 microversion: 2.1 time: 0.103293 Jan 28 02:08:50.847090 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 234/460] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:08:50 2022] GET /compute/v2.1/servers/96b38440-c5bd-4838-bd1b-46312012607e => generated 1222 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:08:50.934349 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-202919b8-dfd4-4898-bda5-c3ea084600c2 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:50.935309 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-202919b8-dfd4-4898-bda5-c3ea084600c2 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:50.943163 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-202919b8-dfd4-4898-bda5-c3ea084600c2 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:50.943609 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-202919b8-dfd4-4898-bda5-c3ea084600c2 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:50.944519 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-202919b8-dfd4-4898-bda5-c3ea084600c2 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:50.945260 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-202919b8-dfd4-4898-bda5-c3ea084600c2 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:51.076213 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-202919b8-dfd4-4898-bda5-c3ea084600c2 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:51.089388 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-202919b8-dfd4-4898-bda5-c3ea084600c2 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:51.090911 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-202919b8-dfd4-4898-bda5-c3ea084600c2 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:51.092429 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-202919b8-dfd4-4898-bda5-c3ea084600c2 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84" status: 200 len: 1739 microversion: 2.20 time: 0.161642 Jan 28 02:08:51.094353 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 227/461] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:08:50 2022] GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84 => generated 1739 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:08:51.490806 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-f9b91c0d-025f-4397-9e26-f939ad986bbd tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:51.491420 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-f9b91c0d-025f-4397-9e26-f939ad986bbd tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] [instance: ec5e47ac-761b-467f-958c-516a9f8bc3e6] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:51.498377 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-f9b91c0d-025f-4397-9e26-f939ad986bbd tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:51.498829 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-f9b91c0d-025f-4397-9e26-f939ad986bbd tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:51.499601 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-f9b91c0d-025f-4397-9e26-f939ad986bbd tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:51.500182 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-f9b91c0d-025f-4397-9e26-f939ad986bbd tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:51.643723 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-f9b91c0d-025f-4397-9e26-f939ad986bbd tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd7039b8f074a13b2030a2bb7aaff94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc19a0f9c33f47f1b504bebbb0b2c931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:51.652392 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-f9b91c0d-025f-4397-9e26-f939ad986bbd tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] 10.222.0.79 "GET /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6" status: 200 len: 1567 microversion: 2.1 time: 0.165244 Jan 28 02:08:51.653246 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 235/462] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:08:51 2022] GET /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6 => generated 1567 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:08:51.730772 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-edbadbee-9583-44ae-8051-5b2c5a64756a tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:51.731553 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-edbadbee-9583-44ae-8051-5b2c5a64756a tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: d5f49055-da38-486c-9f10-1658c64d46f5] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:51.740359 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-edbadbee-9583-44ae-8051-5b2c5a64756a tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:51.741103 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-edbadbee-9583-44ae-8051-5b2c5a64756a tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:51.742075 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-edbadbee-9583-44ae-8051-5b2c5a64756a tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:51.742687 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-edbadbee-9583-44ae-8051-5b2c5a64756a tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:51.863829 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-6ec81eac-43be-4821-90f5-b7c35b8ccd95 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:51.864557 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-6ec81eac-43be-4821-90f5-b7c35b8ccd95 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] [instance: 96b38440-c5bd-4838-bd1b-46312012607e] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:51.877363 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-6ec81eac-43be-4821-90f5-b7c35b8ccd95 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:51.878034 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-6ec81eac-43be-4821-90f5-b7c35b8ccd95 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:51.879923 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-6ec81eac-43be-4821-90f5-b7c35b8ccd95 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:51.882963 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-6ec81eac-43be-4821-90f5-b7c35b8ccd95 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:51.917369 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-edbadbee-9583-44ae-8051-5b2c5a64756a tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acab2a0c4a0e48909317791a3de85b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abe012ba65845329098e0e06c54b9c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:51.936133 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-edbadbee-9583-44ae-8051-5b2c5a64756a tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "GET /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5" status: 200 len: 1723 microversion: 2.1 time: 0.200010 Jan 28 02:08:51.936133 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 228/463] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:08:51 2022] GET /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5 => generated 1723 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:08:51.961493 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-6ec81eac-43be-4821-90f5-b7c35b8ccd95 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b019715a14074e059730965913694e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b66ddee4c864aae90b738695dffbeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:51.976524 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-6ec81eac-43be-4821-90f5-b7c35b8ccd95 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] 10.222.0.79 "GET /compute/v2.1/servers/96b38440-c5bd-4838-bd1b-46312012607e" status: 200 len: 1222 microversion: 2.1 time: 0.117445 Jan 28 02:08:51.978839 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 236/464] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:08:51 2022] GET /compute/v2.1/servers/96b38440-c5bd-4838-bd1b-46312012607e => generated 1222 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:08:52.121165 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-1f0aef2b-7ef5-42d4-a0a4-6a5456dc1913 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:52.121980 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-1f0aef2b-7ef5-42d4-a0a4-6a5456dc1913 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:52.128909 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-1f0aef2b-7ef5-42d4-a0a4-6a5456dc1913 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:52.129347 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-1f0aef2b-7ef5-42d4-a0a4-6a5456dc1913 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:52.130116 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-1f0aef2b-7ef5-42d4-a0a4-6a5456dc1913 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:52.130812 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-1f0aef2b-7ef5-42d4-a0a4-6a5456dc1913 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:52.389562 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-1f0aef2b-7ef5-42d4-a0a4-6a5456dc1913 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:52.401158 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-1f0aef2b-7ef5-42d4-a0a4-6a5456dc1913 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:52.402805 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-1f0aef2b-7ef5-42d4-a0a4-6a5456dc1913 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:52.403986 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-1f0aef2b-7ef5-42d4-a0a4-6a5456dc1913 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84" status: 200 len: 1721 microversion: 2.20 time: 0.286887 Jan 28 02:08:52.411894 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 229/465] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:08:52 2022] GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84 => generated 1721 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:08:52.675189 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-a58ed6d5-ccc4-4fe6-a5fb-a9fa71662a2f tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:52.676315 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-a58ed6d5-ccc4-4fe6-a5fb-a9fa71662a2f tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] [instance: ec5e47ac-761b-467f-958c-516a9f8bc3e6] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:52.683525 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-a58ed6d5-ccc4-4fe6-a5fb-a9fa71662a2f tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:52.684320 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-a58ed6d5-ccc4-4fe6-a5fb-a9fa71662a2f tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:52.685309 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-a58ed6d5-ccc4-4fe6-a5fb-a9fa71662a2f tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:52.685927 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-a58ed6d5-ccc4-4fe6-a5fb-a9fa71662a2f tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:52.945447 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-aa77d85d-b79e-41c6-9b19-9161072132b1 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:52.947381 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-aa77d85d-b79e-41c6-9b19-9161072132b1 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: d5f49055-da38-486c-9f10-1658c64d46f5] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:53.005549 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-aa77d85d-b79e-41c6-9b19-9161072132b1 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:53.007360 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-aa77d85d-b79e-41c6-9b19-9161072132b1 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:53.009122 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-aa77d85d-b79e-41c6-9b19-9161072132b1 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:53.009770 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-aa77d85d-b79e-41c6-9b19-9161072132b1 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:53.049476 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-a58ed6d5-ccc4-4fe6-a5fb-a9fa71662a2f tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd7039b8f074a13b2030a2bb7aaff94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc19a0f9c33f47f1b504bebbb0b2c931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:53.063090 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-a58ed6d5-ccc4-4fe6-a5fb-a9fa71662a2f tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] 10.222.0.79 "GET /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6" status: 200 len: 1567 microversion: 2.1 time: 0.387673 Jan 28 02:08:53.096103 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 237/466] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:08:52 2022] GET /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6 => generated 1567 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:08:53.098970 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-d3412fa2-80c0-42c8-b3b7-86b9ebc945e1 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:53.099580 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-d3412fa2-80c0-42c8-b3b7-86b9ebc945e1 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] [instance: 96b38440-c5bd-4838-bd1b-46312012607e] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:53.135310 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-d3412fa2-80c0-42c8-b3b7-86b9ebc945e1 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:53.135832 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-d3412fa2-80c0-42c8-b3b7-86b9ebc945e1 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:53.138064 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-d3412fa2-80c0-42c8-b3b7-86b9ebc945e1 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:53.138539 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-d3412fa2-80c0-42c8-b3b7-86b9ebc945e1 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:53.289371 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-d3412fa2-80c0-42c8-b3b7-86b9ebc945e1 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b019715a14074e059730965913694e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b66ddee4c864aae90b738695dffbeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:53.316258 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-d3412fa2-80c0-42c8-b3b7-86b9ebc945e1 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] 10.222.0.79 "GET /compute/v2.1/servers/96b38440-c5bd-4838-bd1b-46312012607e" status: 200 len: 1278 microversion: 2.1 time: 0.215063 Jan 28 02:08:53.316258 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 238/467] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:08:53 2022] GET /compute/v2.1/servers/96b38440-c5bd-4838-bd1b-46312012607e => generated 1278 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:08:53.435343 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-fec7662a-9fd5-4ffe-9394-314b64a46935 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:53.436302 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-fec7662a-9fd5-4ffe-9394-314b64a46935 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:53.465912 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-fec7662a-9fd5-4ffe-9394-314b64a46935 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:53.507183 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-fec7662a-9fd5-4ffe-9394-314b64a46935 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:53.507183 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-fec7662a-9fd5-4ffe-9394-314b64a46935 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:53.507183 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-fec7662a-9fd5-4ffe-9394-314b64a46935 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:53.550335 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-aa77d85d-b79e-41c6-9b19-9161072132b1 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acab2a0c4a0e48909317791a3de85b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abe012ba65845329098e0e06c54b9c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:53.560931 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-aa77d85d-b79e-41c6-9b19-9161072132b1 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "GET /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5" status: 200 len: 1723 microversion: 2.1 time: 0.619928 Jan 28 02:08:53.561514 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 230/468] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:08:52 2022] GET /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5 => generated 1723 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:08:53.641533 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [req-2b5e74b5-7bef-4ddf-85c9-7e4d0f2bbc4b req-bfaa54a4-0e58-45d7-8a38-7e42f3c700aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f25403b-0399-48d0-86a9-6e5022287c84", "name": "network-vif-unplugged", "status": "completed", "tag": "eb8f729a-b66f-4c5c-a62e-472c346922bb"}]} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:08:53.643539 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:08:53.643539 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: warnings.warn(msg) Jan 28 02:08:53.651023 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-2b5e74b5-7bef-4ddf-85c9-7e4d0f2bbc4b req-bfaa54a4-0e58-45d7-8a38-7e42f3c700aa service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:53.651564 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-2b5e74b5-7bef-4ddf-85c9-7e4d0f2bbc4b req-bfaa54a4-0e58-45d7-8a38-7e42f3c700aa service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:53.665407 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.compute.server_external_events [req-2b5e74b5-7bef-4ddf-85c9-7e4d0f2bbc4b req-bfaa54a4-0e58-45d7-8a38-7e42f3c700aa service nova] Creating event network-vif-unplugged:eb8f729a-b66f-4c5c-a62e-472c346922bb for instance 4f25403b-0399-48d0-86a9-6e5022287c84 on hv-cinder-82497 Jan 28 02:08:53.668692 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [req-2b5e74b5-7bef-4ddf-85c9-7e4d0f2bbc4b req-bfaa54a4-0e58-45d7-8a38-7e42f3c700aa service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031315 Jan 28 02:08:53.669284 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 231/469] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Jan 28 02:08:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:08:53.735276 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-fec7662a-9fd5-4ffe-9394-314b64a46935 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:53.743172 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-fec7662a-9fd5-4ffe-9394-314b64a46935 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:53.744700 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-fec7662a-9fd5-4ffe-9394-314b64a46935 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:53.745846 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-fec7662a-9fd5-4ffe-9394-314b64a46935 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84" status: 200 len: 1721 microversion: 2.20 time: 0.314917 Jan 28 02:08:53.746396 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 239/470] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:08:53 2022] GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84 => generated 1721 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:08:54.082489 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-fec0a98a-5d3c-400c-8fd6-d731b0cb498c tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:54.083905 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-fec0a98a-5d3c-400c-8fd6-d731b0cb498c tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] [instance: ec5e47ac-761b-467f-958c-516a9f8bc3e6] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:54.093096 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-fec0a98a-5d3c-400c-8fd6-d731b0cb498c tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:54.094534 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-fec0a98a-5d3c-400c-8fd6-d731b0cb498c tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:54.095856 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-fec0a98a-5d3c-400c-8fd6-d731b0cb498c tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:54.096620 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-fec0a98a-5d3c-400c-8fd6-d731b0cb498c tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:54.326377 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-6782e207-5d88-4596-b354-bb6c6846b64d tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:54.330460 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-6782e207-5d88-4596-b354-bb6c6846b64d tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] [instance: 96b38440-c5bd-4838-bd1b-46312012607e] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:54.345963 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-6782e207-5d88-4596-b354-bb6c6846b64d tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:54.346417 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-6782e207-5d88-4596-b354-bb6c6846b64d tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:54.348803 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-6782e207-5d88-4596-b354-bb6c6846b64d tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:54.349949 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-6782e207-5d88-4596-b354-bb6c6846b64d tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:54.372813 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-fec0a98a-5d3c-400c-8fd6-d731b0cb498c tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd7039b8f074a13b2030a2bb7aaff94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc19a0f9c33f47f1b504bebbb0b2c931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:54.394088 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-fec0a98a-5d3c-400c-8fd6-d731b0cb498c tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] 10.222.0.79 "GET /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6" status: 200 len: 1567 microversion: 2.1 time: 0.314086 Jan 28 02:08:54.400739 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 232/471] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:08:54 2022] GET /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6 => generated 1567 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:08:54.453774 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-6782e207-5d88-4596-b354-bb6c6846b64d tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b019715a14074e059730965913694e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b66ddee4c864aae90b738695dffbeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:54.462889 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-6782e207-5d88-4596-b354-bb6c6846b64d tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] 10.222.0.79 "GET /compute/v2.1/servers/96b38440-c5bd-4838-bd1b-46312012607e" status: 200 len: 1276 microversion: 2.1 time: 0.140169 Jan 28 02:08:54.464500 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 240/472] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:08:54 2022] GET /compute/v2.1/servers/96b38440-c5bd-4838-bd1b-46312012607e => generated 1276 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:08:54.578095 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-2ac952b4-3011-476b-bf0f-c39e08914aee tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:54.585164 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-2ac952b4-3011-476b-bf0f-c39e08914aee tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: d5f49055-da38-486c-9f10-1658c64d46f5] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:54.598974 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2ac952b4-3011-476b-bf0f-c39e08914aee tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:54.602690 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2ac952b4-3011-476b-bf0f-c39e08914aee tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:54.603823 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2ac952b4-3011-476b-bf0f-c39e08914aee tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:54.604290 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2ac952b4-3011-476b-bf0f-c39e08914aee tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:54.772036 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-8ef31c72-e269-40a2-b4e1-8a253698b6d8 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:54.773354 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-8ef31c72-e269-40a2-b4e1-8a253698b6d8 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:54.781273 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-8ef31c72-e269-40a2-b4e1-8a253698b6d8 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:54.781988 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-8ef31c72-e269-40a2-b4e1-8a253698b6d8 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:54.782957 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-8ef31c72-e269-40a2-b4e1-8a253698b6d8 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:54.784079 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-8ef31c72-e269-40a2-b4e1-8a253698b6d8 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:54.821934 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-2ac952b4-3011-476b-bf0f-c39e08914aee tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acab2a0c4a0e48909317791a3de85b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abe012ba65845329098e0e06c54b9c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:54.843197 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-2ac952b4-3011-476b-bf0f-c39e08914aee tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "GET /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5" status: 200 len: 1723 microversion: 2.1 time: 0.256200 Jan 28 02:08:54.852596 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 233/473] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:08:54 2022] GET /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5 => generated 1723 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:08:54.963089 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-8ef31c72-e269-40a2-b4e1-8a253698b6d8 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:54.974053 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-8ef31c72-e269-40a2-b4e1-8a253698b6d8 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:54.975878 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-8ef31c72-e269-40a2-b4e1-8a253698b6d8 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:54.977230 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-8ef31c72-e269-40a2-b4e1-8a253698b6d8 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84" status: 200 len: 1721 microversion: 2.20 time: 0.216159 Jan 28 02:08:54.977774 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 241/474] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:08:54 2022] GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84 => generated 1721 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:08:55.411140 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-6c82e79f-14e3-453b-ba80-c2b2500fce83 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:55.412390 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-6c82e79f-14e3-453b-ba80-c2b2500fce83 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] [instance: ec5e47ac-761b-467f-958c-516a9f8bc3e6] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:55.421101 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-6c82e79f-14e3-453b-ba80-c2b2500fce83 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:55.422221 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-6c82e79f-14e3-453b-ba80-c2b2500fce83 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:55.423096 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-6c82e79f-14e3-453b-ba80-c2b2500fce83 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:55.423530 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-6c82e79f-14e3-453b-ba80-c2b2500fce83 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:55.482682 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-6476de5a-6aea-409f-a9aa-b00a7f646dbb tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:55.483202 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-6476de5a-6aea-409f-a9aa-b00a7f646dbb tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] [instance: 96b38440-c5bd-4838-bd1b-46312012607e] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:55.490677 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-6476de5a-6aea-409f-a9aa-b00a7f646dbb tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:55.491255 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-6476de5a-6aea-409f-a9aa-b00a7f646dbb tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:55.492168 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-6476de5a-6aea-409f-a9aa-b00a7f646dbb tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:55.492694 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-6476de5a-6aea-409f-a9aa-b00a7f646dbb tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:55.592779 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-6c82e79f-14e3-453b-ba80-c2b2500fce83 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd7039b8f074a13b2030a2bb7aaff94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc19a0f9c33f47f1b504bebbb0b2c931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:55.607515 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-6c82e79f-14e3-453b-ba80-c2b2500fce83 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] 10.222.0.79 "GET /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6" status: 200 len: 1567 microversion: 2.1 time: 0.199970 Jan 28 02:08:55.609514 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 234/475] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:08:55 2022] GET /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6 => generated 1567 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:08:55.664859 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-6476de5a-6aea-409f-a9aa-b00a7f646dbb tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b019715a14074e059730965913694e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b66ddee4c864aae90b738695dffbeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:55.672947 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-6476de5a-6aea-409f-a9aa-b00a7f646dbb tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] 10.222.0.79 "GET /compute/v2.1/servers/96b38440-c5bd-4838-bd1b-46312012607e" status: 200 len: 1318 microversion: 2.1 time: 0.194536 Jan 28 02:08:55.678092 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 242/476] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:08:55 2022] GET /compute/v2.1/servers/96b38440-c5bd-4838-bd1b-46312012607e => generated 1318 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:08:55.861796 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-ab01b84b-0802-43f3-af0c-1cdb87aaf40d tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:55.862314 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-ab01b84b-0802-43f3-af0c-1cdb87aaf40d tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: d5f49055-da38-486c-9f10-1658c64d46f5] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:55.869227 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ab01b84b-0802-43f3-af0c-1cdb87aaf40d tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:55.869787 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ab01b84b-0802-43f3-af0c-1cdb87aaf40d tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:55.870634 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ab01b84b-0802-43f3-af0c-1cdb87aaf40d tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:55.871320 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ab01b84b-0802-43f3-af0c-1cdb87aaf40d tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:55.998534 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-c829aa13-1096-4e0c-84ed-2bb895b402d0 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:56.000524 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-c829aa13-1096-4e0c-84ed-2bb895b402d0 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:56.006456 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-c829aa13-1096-4e0c-84ed-2bb895b402d0 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:56.007126 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-c829aa13-1096-4e0c-84ed-2bb895b402d0 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:56.007886 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-c829aa13-1096-4e0c-84ed-2bb895b402d0 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:56.008361 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-c829aa13-1096-4e0c-84ed-2bb895b402d0 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:56.017187 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-ab01b84b-0802-43f3-af0c-1cdb87aaf40d tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acab2a0c4a0e48909317791a3de85b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abe012ba65845329098e0e06c54b9c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:56.026999 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-ab01b84b-0802-43f3-af0c-1cdb87aaf40d tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "GET /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5" status: 200 len: 1723 microversion: 2.1 time: 0.169468 Jan 28 02:08:56.028155 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 235/477] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:08:55 2022] GET /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5 => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:08:56.160240 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-c829aa13-1096-4e0c-84ed-2bb895b402d0 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:56.168606 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-c829aa13-1096-4e0c-84ed-2bb895b402d0 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:56.170425 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-c829aa13-1096-4e0c-84ed-2bb895b402d0 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:56.171863 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-c829aa13-1096-4e0c-84ed-2bb895b402d0 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84" status: 200 len: 1721 microversion: 2.20 time: 0.177309 Jan 28 02:08:56.182761 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 243/478] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:08:55 2022] GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84 => generated 1721 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:08:56.626588 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-c2be0ff9-fdb1-4ceb-bdf7-a3a705a5cc46 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:56.627229 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-c2be0ff9-fdb1-4ceb-bdf7-a3a705a5cc46 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] [instance: ec5e47ac-761b-467f-958c-516a9f8bc3e6] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:56.633687 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c2be0ff9-fdb1-4ceb-bdf7-a3a705a5cc46 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:56.634142 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c2be0ff9-fdb1-4ceb-bdf7-a3a705a5cc46 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:56.634952 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c2be0ff9-fdb1-4ceb-bdf7-a3a705a5cc46 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:56.635380 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c2be0ff9-fdb1-4ceb-bdf7-a3a705a5cc46 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:56.690674 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-2099732c-e5a0-4446-900d-b88975a9c538 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:56.691293 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-2099732c-e5a0-4446-900d-b88975a9c538 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] [instance: 96b38440-c5bd-4838-bd1b-46312012607e] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:56.697380 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-2099732c-e5a0-4446-900d-b88975a9c538 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:56.697833 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-2099732c-e5a0-4446-900d-b88975a9c538 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:56.698622 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-2099732c-e5a0-4446-900d-b88975a9c538 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:56.699055 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-2099732c-e5a0-4446-900d-b88975a9c538 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:56.848125 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-c2be0ff9-fdb1-4ceb-bdf7-a3a705a5cc46 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd7039b8f074a13b2030a2bb7aaff94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc19a0f9c33f47f1b504bebbb0b2c931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:56.857702 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-c2be0ff9-fdb1-4ceb-bdf7-a3a705a5cc46 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] 10.222.0.79 "GET /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6" status: 200 len: 1567 microversion: 2.1 time: 0.235528 Jan 28 02:08:56.858694 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 236/479] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:08:56 2022] GET /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6 => generated 1567 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:08:56.891308 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-2099732c-e5a0-4446-900d-b88975a9c538 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b019715a14074e059730965913694e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b66ddee4c864aae90b738695dffbeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:56.901325 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-2099732c-e5a0-4446-900d-b88975a9c538 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] 10.222.0.79 "GET /compute/v2.1/servers/96b38440-c5bd-4838-bd1b-46312012607e" status: 200 len: 1318 microversion: 2.1 time: 0.214774 Jan 28 02:08:56.902012 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 244/480] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:08:56 2022] GET /compute/v2.1/servers/96b38440-c5bd-4838-bd1b-46312012607e => generated 1318 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:08:57.044709 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-e8056514-983b-4871-8f7d-5ab70667bcc0 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:57.045291 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-e8056514-983b-4871-8f7d-5ab70667bcc0 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: d5f49055-da38-486c-9f10-1658c64d46f5] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:57.051645 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-e8056514-983b-4871-8f7d-5ab70667bcc0 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:57.052111 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-e8056514-983b-4871-8f7d-5ab70667bcc0 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:57.052866 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-e8056514-983b-4871-8f7d-5ab70667bcc0 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:57.053289 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-e8056514-983b-4871-8f7d-5ab70667bcc0 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:57.186295 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-e8056514-983b-4871-8f7d-5ab70667bcc0 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acab2a0c4a0e48909317791a3de85b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abe012ba65845329098e0e06c54b9c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:57.190549 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-6655f435-6f15-4d79-a939-dc8d46ee1c46 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:57.191151 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-6655f435-6f15-4d79-a939-dc8d46ee1c46 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:57.200875 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-6655f435-6f15-4d79-a939-dc8d46ee1c46 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:57.201399 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-6655f435-6f15-4d79-a939-dc8d46ee1c46 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:57.202389 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-6655f435-6f15-4d79-a939-dc8d46ee1c46 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:57.203049 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-6655f435-6f15-4d79-a939-dc8d46ee1c46 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:57.208618 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-e8056514-983b-4871-8f7d-5ab70667bcc0 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "GET /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5" status: 200 len: 1723 microversion: 2.1 time: 0.160925 Jan 28 02:08:57.209227 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 237/481] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:08:57 2022] GET /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:08:57.332102 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-6655f435-6f15-4d79-a939-dc8d46ee1c46 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:57.341520 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-6655f435-6f15-4d79-a939-dc8d46ee1c46 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:57.344595 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-6655f435-6f15-4d79-a939-dc8d46ee1c46 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:57.345758 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-6655f435-6f15-4d79-a939-dc8d46ee1c46 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84" status: 200 len: 1721 microversion: 2.20 time: 0.159591 Jan 28 02:08:57.346317 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 245/482] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:08:57 2022] GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84 => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 02:08:57.874332 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-f7400ea1-e377-429c-ade9-1dd7a57663b4 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:57.877268 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-f7400ea1-e377-429c-ade9-1dd7a57663b4 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] [instance: ec5e47ac-761b-467f-958c-516a9f8bc3e6] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:57.883138 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f7400ea1-e377-429c-ade9-1dd7a57663b4 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:57.883946 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f7400ea1-e377-429c-ade9-1dd7a57663b4 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:57.884741 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f7400ea1-e377-429c-ade9-1dd7a57663b4 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:57.885168 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f7400ea1-e377-429c-ade9-1dd7a57663b4 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:57.918876 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-b1c1e5ac-7e23-4d15-9c96-dc9e22b175dc tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:57.919487 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-b1c1e5ac-7e23-4d15-9c96-dc9e22b175dc tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] [instance: 96b38440-c5bd-4838-bd1b-46312012607e] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:57.926535 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-b1c1e5ac-7e23-4d15-9c96-dc9e22b175dc tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:57.927016 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-b1c1e5ac-7e23-4d15-9c96-dc9e22b175dc tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:57.927794 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-b1c1e5ac-7e23-4d15-9c96-dc9e22b175dc tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:57.928256 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-b1c1e5ac-7e23-4d15-9c96-dc9e22b175dc tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:58.046608 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-f7400ea1-e377-429c-ade9-1dd7a57663b4 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd7039b8f074a13b2030a2bb7aaff94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc19a0f9c33f47f1b504bebbb0b2c931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:58.056697 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-f7400ea1-e377-429c-ade9-1dd7a57663b4 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] 10.222.0.79 "GET /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6" status: 200 len: 1567 microversion: 2.1 time: 0.185993 Jan 28 02:08:58.057254 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 238/483] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:08:57 2022] GET /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6 => generated 1567 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:08:58.098762 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-b1c1e5ac-7e23-4d15-9c96-dc9e22b175dc tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b019715a14074e059730965913694e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b66ddee4c864aae90b738695dffbeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:58.106183 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-b1c1e5ac-7e23-4d15-9c96-dc9e22b175dc tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] 10.222.0.79 "GET /compute/v2.1/servers/96b38440-c5bd-4838-bd1b-46312012607e" status: 200 len: 1318 microversion: 2.1 time: 0.190990 Jan 28 02:08:58.107022 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 246/484] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:08:57 2022] GET /compute/v2.1/servers/96b38440-c5bd-4838-bd1b-46312012607e => generated 1318 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:08:58.230060 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-ab4645e2-87e4-42be-8d0d-fe8d4521b8cf tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:58.230928 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-ab4645e2-87e4-42be-8d0d-fe8d4521b8cf tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: d5f49055-da38-486c-9f10-1658c64d46f5] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:58.238810 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ab4645e2-87e4-42be-8d0d-fe8d4521b8cf tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:58.241154 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ab4645e2-87e4-42be-8d0d-fe8d4521b8cf tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:58.241154 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ab4645e2-87e4-42be-8d0d-fe8d4521b8cf tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:58.241154 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ab4645e2-87e4-42be-8d0d-fe8d4521b8cf tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:58.279681 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-7ebe2a5e-9387-4f4e-99bb-0a695a979ee6 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Action: 'create', calling method: .version_select at 0x7f837d1bf3a0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-845287693"}} {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:08:58.301534 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.quota [None req-7ebe2a5e-9387-4f4e-99bb-0a695a979ee6 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Getting quotas for project 2e991e35dc5b463fbf9f08db0e72cf46. Resources: {'key_pairs'} {{(pid=116374) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 02:08:58.306707 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.quota [None req-7ebe2a5e-9387-4f4e-99bb-0a695a979ee6 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Getting quotas for user 14f6f890deb74eadab6b1ff4b6431036 and project 2e991e35dc5b463fbf9f08db0e72cf46. Resources: {'key_pairs'} {{(pid=116374) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 02:08:58.440184 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-ab4645e2-87e4-42be-8d0d-fe8d4521b8cf tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acab2a0c4a0e48909317791a3de85b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abe012ba65845329098e0e06c54b9c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:58.451128 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-ab4645e2-87e4-42be-8d0d-fe8d4521b8cf tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "GET /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5" status: 200 len: 1723 microversion: 2.1 time: 0.227221 Jan 28 02:08:58.463309 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 239/485] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:08:58 2022] GET /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5 => generated 1723 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:08:58.470003 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-e572dab2-4857-476c-b7ad-4dd1ab99fb20 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:58.470647 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-e572dab2-4857-476c-b7ad-4dd1ab99fb20 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:58.477501 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-e572dab2-4857-476c-b7ad-4dd1ab99fb20 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:58.477971 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-e572dab2-4857-476c-b7ad-4dd1ab99fb20 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:58.478750 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-e572dab2-4857-476c-b7ad-4dd1ab99fb20 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:58.479179 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-e572dab2-4857-476c-b7ad-4dd1ab99fb20 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:58.641385 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-e572dab2-4857-476c-b7ad-4dd1ab99fb20 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:58.649838 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-e572dab2-4857-476c-b7ad-4dd1ab99fb20 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:58.651119 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-e572dab2-4857-476c-b7ad-4dd1ab99fb20 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:58.652293 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-e572dab2-4857-476c-b7ad-4dd1ab99fb20 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84" status: 200 len: 1721 microversion: 2.20 time: 0.187652 Jan 28 02:08:58.652847 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 240/486] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:08:58 2022] GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84 => generated 1721 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:08:58.923740 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.quota [None req-7ebe2a5e-9387-4f4e-99bb-0a695a979ee6 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Getting quotas for project 2e991e35dc5b463fbf9f08db0e72cf46. Resources: {'key_pairs'} {{(pid=116374) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 02:08:58.927384 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.quota [None req-7ebe2a5e-9387-4f4e-99bb-0a695a979ee6 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Getting quotas for user 14f6f890deb74eadab6b1ff4b6431036 and project 2e991e35dc5b463fbf9f08db0e72cf46. Resources: {'key_pairs'} {{(pid=116374) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 02:08:58.940713 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-7ebe2a5e-9387-4f4e-99bb-0a695a979ee6 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 2321 microversion: 2.1 time: 0.664694 Jan 28 02:08:58.941325 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 247/487] 10.222.0.79 () {60 vars in 1157 bytes} [Fri Jan 28 02:08:58 2022] POST /compute/v2.1/os-keypairs => generated 2321 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:08:58.991375 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-b1c78dbb-4b81-4387-8566-f3117e01a8a8 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1338445348", "imageRef": "864327f7-9b5c-468d-93db-096d5f1fbdb3", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-845287693", "networks": [{"uuid": "292dd6a5-430d-4e8a-a8ac-8f1544aeecf7"}]}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:08:59.041998 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.network.neutron [None req-b1c78dbb-4b81-4387-8566-f3117e01a8a8 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] validate_networks() for [('292dd6a5-430d-4e8a-a8ac-8f1544aeecf7', None, None, None, None, None)] {{(pid=116375) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Jan 28 02:08:59.073848 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [req-d911b672-9493-4fda-bf89-0be3bb73d9b0 req-2a5d04c2-2b60-4fb8-91ac-b6b4813555b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96b38440-c5bd-4838-bd1b-46312012607e", "tag": "8d7133bd-248c-438b-adfd-1ef3f2765032"}]} {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:08:59.075656 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:08:59.075656 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: warnings.warn(msg) Jan 28 02:08:59.083610 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [req-d911b672-9493-4fda-bf89-0be3bb73d9b0 req-2a5d04c2-2b60-4fb8-91ac-b6b4813555b8 service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:59.084157 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [req-d911b672-9493-4fda-bf89-0be3bb73d9b0 req-2a5d04c2-2b60-4fb8-91ac-b6b4813555b8 service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:59.102659 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.compute.server_external_events [req-d911b672-9493-4fda-bf89-0be3bb73d9b0 req-2a5d04c2-2b60-4fb8-91ac-b6b4813555b8 service nova] Creating event network-changed:8d7133bd-248c-438b-adfd-1ef3f2765032 for instance 96b38440-c5bd-4838-bd1b-46312012607e on hv-cinder-82497 Jan 28 02:08:59.107721 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [req-d911b672-9493-4fda-bf89-0be3bb73d9b0 req-2a5d04c2-2b60-4fb8-91ac-b6b4813555b8 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037524 Jan 28 02:08:59.108659 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 248/488] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Jan 28 02:08:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:08:59.115654 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-9324a107-aeaf-4f98-a519-026391b07ced tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:59.117510 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-9324a107-aeaf-4f98-a519-026391b07ced tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] [instance: ec5e47ac-761b-467f-958c-516a9f8bc3e6] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:59.122499 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-9324a107-aeaf-4f98-a519-026391b07ced tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:59.122941 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-9324a107-aeaf-4f98-a519-026391b07ced tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:59.123707 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-9324a107-aeaf-4f98-a519-026391b07ced tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:59.124161 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-9324a107-aeaf-4f98-a519-026391b07ced tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:59.315227 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-9324a107-aeaf-4f98-a519-026391b07ced tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd7039b8f074a13b2030a2bb7aaff94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc19a0f9c33f47f1b504bebbb0b2c931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:59.323671 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-9324a107-aeaf-4f98-a519-026391b07ced tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] 10.222.0.79 "GET /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6" status: 200 len: 1567 microversion: 2.1 time: 0.213583 Jan 28 02:08:59.334636 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 249/489] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:08:59 2022] GET /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6 => generated 1567 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:08:59.334636 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-a220babb-c8f2-4c64-9acd-c42612fbc43a tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:59.334636 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-a220babb-c8f2-4c64-9acd-c42612fbc43a tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] [instance: 96b38440-c5bd-4838-bd1b-46312012607e] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:59.335955 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-a220babb-c8f2-4c64-9acd-c42612fbc43a tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:59.336466 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-a220babb-c8f2-4c64-9acd-c42612fbc43a tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:59.337239 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-a220babb-c8f2-4c64-9acd-c42612fbc43a tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:59.337955 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-a220babb-c8f2-4c64-9acd-c42612fbc43a tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:59.581962 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.virt.hardware [None req-b1c78dbb-4b81-4387-8566-f3117e01a8a8 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Flavor limits 0:0:0 {{(pid=116375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 02:08:59.582131 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.virt.hardware [None req-b1c78dbb-4b81-4387-8566-f3117e01a8a8 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Image limits 0:0:0 {{(pid=116375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 02:08:59.582603 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.virt.hardware [None req-b1c78dbb-4b81-4387-8566-f3117e01a8a8 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Flavor pref 0:0:0 {{(pid=116375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 02:08:59.583004 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.virt.hardware [None req-b1c78dbb-4b81-4387-8566-f3117e01a8a8 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Image pref 0:0:0 {{(pid=116375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 02:08:59.583411 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.virt.hardware [None req-b1c78dbb-4b81-4387-8566-f3117e01a8a8 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 02:08:59.592538 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-a220babb-c8f2-4c64-9acd-c42612fbc43a tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b019715a14074e059730965913694e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b66ddee4c864aae90b738695dffbeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:59.601556 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-a220babb-c8f2-4c64-9acd-c42612fbc43a tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] 10.222.0.79 "GET /compute/v2.1/servers/96b38440-c5bd-4838-bd1b-46312012607e" status: 200 len: 1318 microversion: 2.1 time: 0.276018 Jan 28 02:08:59.602935 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 250/490] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:08:59 2022] GET /compute/v2.1/servers/96b38440-c5bd-4838-bd1b-46312012607e => generated 1318 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:08:59.611865 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b1c78dbb-4b81-4387-8566-f3117e01a8a8 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:59.612338 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b1c78dbb-4b81-4387-8566-f3117e01a8a8 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:59.613178 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b1c78dbb-4b81-4387-8566-f3117e01a8a8 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:59.613609 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b1c78dbb-4b81-4387-8566-f3117e01a8a8 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:59.621097 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-647ab32d-5069-410b-9412-8b2464a374c0 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:59.621884 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-647ab32d-5069-410b-9412-8b2464a374c0 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: d5f49055-da38-486c-9f10-1658c64d46f5] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:59.630328 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-647ab32d-5069-410b-9412-8b2464a374c0 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:59.632005 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-647ab32d-5069-410b-9412-8b2464a374c0 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:59.633005 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-647ab32d-5069-410b-9412-8b2464a374c0 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:59.635658 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-647ab32d-5069-410b-9412-8b2464a374c0 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:59.648223 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.quota [None req-b1c78dbb-4b81-4387-8566-f3117e01a8a8 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Getting quotas for project 2e991e35dc5b463fbf9f08db0e72cf46. Resources: {'ram', 'cores', 'instances'} {{(pid=116375) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 02:08:59.654840 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.quota [None req-b1c78dbb-4b81-4387-8566-f3117e01a8a8 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Getting quotas for user 14f6f890deb74eadab6b1ff4b6431036 and project 2e991e35dc5b463fbf9f08db0e72cf46. Resources: {'ram', 'cores', 'instances'} {{(pid=116375) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 02:08:59.688307 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-b1c78dbb-4b81-4387-8566-f3117e01a8a8 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Going to run 1 instances... {{(pid=116375) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 02:08:59.690836 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-b1c78dbb-4b81-4387-8566-f3117e01a8a8 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] [instance: 086c6296-168f-46fc-9ec4-8700b7c6ca9f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='864327f7-9b5c-468d-93db-096d5f1fbdb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116375) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 02:08:59.779247 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-647ab32d-5069-410b-9412-8b2464a374c0 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acab2a0c4a0e48909317791a3de85b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abe012ba65845329098e0e06c54b9c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:08:59.789162 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-647ab32d-5069-410b-9412-8b2464a374c0 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "GET /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5" status: 200 len: 1700 microversion: 2.1 time: 0.185984 Jan 28 02:08:59.791605 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 251/491] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:08:59 2022] GET /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5 => generated 1700 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:08:59.804823 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-9f219010-c2c2-4aac-8f50-6c78106c69db tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:08:59.805541 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-9f219010-c2c2-4aac-8f50-6c78106c69db tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:08:59.811882 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-9f219010-c2c2-4aac-8f50-6c78106c69db tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:59.814660 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-9f219010-c2c2-4aac-8f50-6c78106c69db tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:59.814660 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-9f219010-c2c2-4aac-8f50-6c78106c69db tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:59.814660 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-9f219010-c2c2-4aac-8f50-6c78106c69db tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:59.823206 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-b1c78dbb-4b81-4387-8566-f3117e01a8a8 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.835473 Jan 28 02:08:59.823853 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 241/492] 10.222.0.79 () {60 vars in 1146 bytes} [Fri Jan 28 02:08:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 837 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 28 02:08:59.834512 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-3c24aca3-9f70-46d3-8733-acfe9b32ef77 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:08:59.841078 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-3c24aca3-9f70-46d3-8733-acfe9b32ef77 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:08:59.841601 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-3c24aca3-9f70-46d3-8733-acfe9b32ef77 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:08:59.908030 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-3c24aca3-9f70-46d3-8733-acfe9b32ef77 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: d5f49055-da38-486c-9f10-1658c64d46f5] Going to try to start instance {{(pid=116375) start /opt/stack/nova/nova/compute/api.py:2675}} Jan 28 02:09:00.008482 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-9f219010-c2c2-4aac-8f50-6c78106c69db tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:00.037655 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-9f219010-c2c2-4aac-8f50-6c78106c69db tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:00.039163 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-9f219010-c2c2-4aac-8f50-6c78106c69db tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:00.042766 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-9f219010-c2c2-4aac-8f50-6c78106c69db tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84" status: 200 len: 1721 microversion: 2.20 time: 0.239382 Jan 28 02:09:00.043329 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 252/493] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:08:59 2022] GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84 => generated 1721 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:09:00.067205 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-65d61ffc-e07e-4e44-90a1-e368a6174747 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:00.072013 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-65d61ffc-e07e-4e44-90a1-e368a6174747 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] [instance: 086c6296-168f-46fc-9ec4-8700b7c6ca9f] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:00.133039 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-65d61ffc-e07e-4e44-90a1-e368a6174747 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14f6f890deb74eadab6b1ff4b6431036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e991e35dc5b463fbf9f08db0e72cf46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:00.146376 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-3c24aca3-9f70-46d3-8733-acfe9b32ef77 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "POST /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5/action" status: 202 len: 0 microversion: 2.1 time: 0.316022 Jan 28 02:09:00.147175 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 242/494] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Jan 28 02:08:59 2022] POST /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5/action => generated 0 bytes in 323 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:09:00.148527 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-65d61ffc-e07e-4e44-90a1-e368a6174747 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] 10.222.0.79 "GET /compute/v2.1/servers/086c6296-168f-46fc-9ec4-8700b7c6ca9f" status: 200 len: 1258 microversion: 2.1 time: 0.104071 Jan 28 02:09:00.166132 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 253/495] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:09:00 2022] GET /compute/v2.1/servers/086c6296-168f-46fc-9ec4-8700b7c6ca9f => generated 1258 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:09:00.166572 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-8410c7f9-5cde-4ba0-bb91-49c2adbc8a99 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:00.166572 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-8410c7f9-5cde-4ba0-bb91-49c2adbc8a99 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: d5f49055-da38-486c-9f10-1658c64d46f5] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:00.172564 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-8410c7f9-5cde-4ba0-bb91-49c2adbc8a99 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:00.173813 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-8410c7f9-5cde-4ba0-bb91-49c2adbc8a99 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:00.174621 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-8410c7f9-5cde-4ba0-bb91-49c2adbc8a99 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:00.175829 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-8410c7f9-5cde-4ba0-bb91-49c2adbc8a99 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:00.334059 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-8410c7f9-5cde-4ba0-bb91-49c2adbc8a99 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acab2a0c4a0e48909317791a3de85b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abe012ba65845329098e0e06c54b9c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:00.341357 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-4c0d2c86-9642-40ed-bbcc-d9b811b68f6b tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:00.349610 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-4c0d2c86-9642-40ed-bbcc-d9b811b68f6b tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] [instance: ec5e47ac-761b-467f-958c-516a9f8bc3e6] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:00.357991 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-8410c7f9-5cde-4ba0-bb91-49c2adbc8a99 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "GET /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5" status: 200 len: 1709 microversion: 2.1 time: 0.198245 Jan 28 02:09:00.359345 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 243/496] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:09:00 2022] GET /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5 => generated 1709 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:09:00.364520 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-4c0d2c86-9642-40ed-bbcc-d9b811b68f6b tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:00.365230 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-4c0d2c86-9642-40ed-bbcc-d9b811b68f6b tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:00.366198 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-4c0d2c86-9642-40ed-bbcc-d9b811b68f6b tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:00.367385 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-4c0d2c86-9642-40ed-bbcc-d9b811b68f6b tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:00.518634 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-4c0d2c86-9642-40ed-bbcc-d9b811b68f6b tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd7039b8f074a13b2030a2bb7aaff94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc19a0f9c33f47f1b504bebbb0b2c931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:00.527023 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-4c0d2c86-9642-40ed-bbcc-d9b811b68f6b tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] 10.222.0.79 "GET /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6" status: 200 len: 1567 microversion: 2.1 time: 0.189433 Jan 28 02:09:00.527605 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 254/497] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:09:00 2022] GET /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6 => generated 1567 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:09:00.620700 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-698cc04e-341f-419c-ac2b-c983f912a2de tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:00.621523 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-698cc04e-341f-419c-ac2b-c983f912a2de tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] [instance: 96b38440-c5bd-4838-bd1b-46312012607e] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:00.629591 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-698cc04e-341f-419c-ac2b-c983f912a2de tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:00.630311 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-698cc04e-341f-419c-ac2b-c983f912a2de tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:00.631682 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-698cc04e-341f-419c-ac2b-c983f912a2de tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:00.632222 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-698cc04e-341f-419c-ac2b-c983f912a2de tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:00.766352 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-698cc04e-341f-419c-ac2b-c983f912a2de tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b019715a14074e059730965913694e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b66ddee4c864aae90b738695dffbeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:00.773977 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-698cc04e-341f-419c-ac2b-c983f912a2de tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] 10.222.0.79 "GET /compute/v2.1/servers/96b38440-c5bd-4838-bd1b-46312012607e" status: 200 len: 1318 microversion: 2.1 time: 0.156804 Jan 28 02:09:00.774872 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 244/498] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:09:00 2022] GET /compute/v2.1/servers/96b38440-c5bd-4838-bd1b-46312012607e => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:09:01.065654 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-226a532e-cd97-42ac-8170-83fb38327a01 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:01.067297 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-226a532e-cd97-42ac-8170-83fb38327a01 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:01.073016 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-226a532e-cd97-42ac-8170-83fb38327a01 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:01.073854 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-226a532e-cd97-42ac-8170-83fb38327a01 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:01.074648 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-226a532e-cd97-42ac-8170-83fb38327a01 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:01.075245 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-226a532e-cd97-42ac-8170-83fb38327a01 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:01.173916 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-d06b9cb2-6144-40c7-b2e4-ce05c4b6a4db tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:01.174779 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-d06b9cb2-6144-40c7-b2e4-ce05c4b6a4db tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] [instance: 086c6296-168f-46fc-9ec4-8700b7c6ca9f] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:01.235963 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-d06b9cb2-6144-40c7-b2e4-ce05c4b6a4db tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14f6f890deb74eadab6b1ff4b6431036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e991e35dc5b463fbf9f08db0e72cf46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:01.239625 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-226a532e-cd97-42ac-8170-83fb38327a01 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:01.247014 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-d06b9cb2-6144-40c7-b2e4-ce05c4b6a4db tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] 10.222.0.79 "GET /compute/v2.1/servers/086c6296-168f-46fc-9ec4-8700b7c6ca9f" status: 200 len: 1258 microversion: 2.1 time: 0.077980 Jan 28 02:09:01.247599 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 245/499] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:09:01 2022] GET /compute/v2.1/servers/086c6296-168f-46fc-9ec4-8700b7c6ca9f => generated 1258 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:09:01.257352 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-226a532e-cd97-42ac-8170-83fb38327a01 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:01.257352 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-226a532e-cd97-42ac-8170-83fb38327a01 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:01.257352 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-226a532e-cd97-42ac-8170-83fb38327a01 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84" status: 200 len: 1664 microversion: 2.20 time: 0.192857 Jan 28 02:09:01.257701 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 255/500] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:09:01 2022] GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84 => generated 1664 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:09:01.283300 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-1ebe80fa-6d9f-4168-a067-0287de835c6c tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dac4f435-89c0-430b-8eb7-66be785cbcbe"}} {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:09:01.287129 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-1ebe80fa-6d9f-4168-a067-0287de835c6c tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:01.296485 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-1ebe80fa-6d9f-4168-a067-0287de835c6c tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:01.297333 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-1ebe80fa-6d9f-4168-a067-0287de835c6c tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:01.298740 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-1ebe80fa-6d9f-4168-a067-0287de835c6c tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:01.299366 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-1ebe80fa-6d9f-4168-a067-0287de835c6c tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:01.380745 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-0a9d2b0b-3601-437b-af29-fe18e7656873 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:01.381493 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-0a9d2b0b-3601-437b-af29-fe18e7656873 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: d5f49055-da38-486c-9f10-1658c64d46f5] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:01.387812 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-0a9d2b0b-3601-437b-af29-fe18e7656873 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:01.389664 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-0a9d2b0b-3601-437b-af29-fe18e7656873 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:01.389664 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-0a9d2b0b-3601-437b-af29-fe18e7656873 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:01.389664 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-0a9d2b0b-3601-437b-af29-fe18e7656873 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:01.522427 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-0a9d2b0b-3601-437b-af29-fe18e7656873 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acab2a0c4a0e48909317791a3de85b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abe012ba65845329098e0e06c54b9c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:01.537883 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-0a9d2b0b-3601-437b-af29-fe18e7656873 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "GET /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5" status: 200 len: 1709 microversion: 2.1 time: 0.160536 Jan 28 02:09:01.538586 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 246/501] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:09:01 2022] GET /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5 => generated 1709 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:09:01.556627 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-e836e9fd-f5fb-4bb3-88fc-4daf97cf5376 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:01.557234 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-e836e9fd-f5fb-4bb3-88fc-4daf97cf5376 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] [instance: ec5e47ac-761b-467f-958c-516a9f8bc3e6] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:01.564246 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-e836e9fd-f5fb-4bb3-88fc-4daf97cf5376 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:01.564827 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-e836e9fd-f5fb-4bb3-88fc-4daf97cf5376 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:01.565828 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-e836e9fd-f5fb-4bb3-88fc-4daf97cf5376 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:01.566364 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-e836e9fd-f5fb-4bb3-88fc-4daf97cf5376 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:01.699953 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-e836e9fd-f5fb-4bb3-88fc-4daf97cf5376 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd7039b8f074a13b2030a2bb7aaff94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc19a0f9c33f47f1b504bebbb0b2c931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:01.708481 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-e836e9fd-f5fb-4bb3-88fc-4daf97cf5376 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] 10.222.0.79 "GET /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6" status: 200 len: 1547 microversion: 2.1 time: 0.166441 Jan 28 02:09:01.713383 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 247/502] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:09:01 2022] GET /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6 => generated 1547 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:09:01.726134 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-6b6e677c-a5e0-4871-9184-6b7e592f83b6 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:01.726622 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-6b6e677c-a5e0-4871-9184-6b7e592f83b6 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] [instance: ec5e47ac-761b-467f-958c-516a9f8bc3e6] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:01.732457 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-6b6e677c-a5e0-4871-9184-6b7e592f83b6 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:01.732952 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-6b6e677c-a5e0-4871-9184-6b7e592f83b6 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:01.736693 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-6b6e677c-a5e0-4871-9184-6b7e592f83b6 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:01.736693 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-6b6e677c-a5e0-4871-9184-6b7e592f83b6 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:01.865031 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.wsgi [None req-6b6e677c-a5e0-4871-9184-6b7e592f83b6 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] HTTP exception thrown: Cannot 'detach_volume' instance ec5e47ac-761b-467f-958c-516a9f8bc3e6 while it is in vm_state rescued Jan 28 02:09:01.865620 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-6b6e677c-a5e0-4871-9184-6b7e592f83b6 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Returning 409 to user: Cannot 'detach_volume' instance ec5e47ac-761b-467f-958c-516a9f8bc3e6 while it is in vm_state rescued {{(pid=116375) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 02:09:01.866610 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-6b6e677c-a5e0-4871-9184-6b7e592f83b6 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] 10.222.0.79 "DELETE /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6/os-volume_attachments/86479932-7d1f-45f3-9fec-b01e2a4a4f70" status: 409 len: 152 microversion: 2.1 time: 0.144291 Jan 28 02:09:01.867353 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 248/503] 10.222.0.79 () {58 vars in 1415 bytes} [Fri Jan 28 02:09:01 2022] DELETE /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6/os-volume_attachments/86479932-7d1f-45f3-9fec-b01e2a4a4f70 => generated 152 bytes in 146 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jan 28 02:09:01.871616 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-12bbb24a-8f64-488c-8a62-ad4ee836b813 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:01.872234 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-12bbb24a-8f64-488c-8a62-ad4ee836b813 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] [instance: 96b38440-c5bd-4838-bd1b-46312012607e] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:01.879327 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-12bbb24a-8f64-488c-8a62-ad4ee836b813 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:01.879772 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-12bbb24a-8f64-488c-8a62-ad4ee836b813 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:01.880579 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-12bbb24a-8f64-488c-8a62-ad4ee836b813 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:01.880990 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-12bbb24a-8f64-488c-8a62-ad4ee836b813 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:02.008932 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-12bbb24a-8f64-488c-8a62-ad4ee836b813 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b019715a14074e059730965913694e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b66ddee4c864aae90b738695dffbeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:02.016929 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-12bbb24a-8f64-488c-8a62-ad4ee836b813 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] 10.222.0.79 "GET /compute/v2.1/servers/96b38440-c5bd-4838-bd1b-46312012607e" status: 200 len: 1318 microversion: 2.1 time: 0.148548 Jan 28 02:09:02.017478 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 249/504] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:09:01 2022] GET /compute/v2.1/servers/96b38440-c5bd-4838-bd1b-46312012607e => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:09:02.023567 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-11e86fd5-d600-4b57-928e-859ffdb1d780 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:09:02.023567 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-11e86fd5-d600-4b57-928e-859ffdb1d780 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] [instance: ec5e47ac-761b-467f-958c-516a9f8bc3e6] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:02.028575 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-11e86fd5-d600-4b57-928e-859ffdb1d780 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:02.029021 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-11e86fd5-d600-4b57-928e-859ffdb1d780 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:02.029785 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-11e86fd5-d600-4b57-928e-859ffdb1d780 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:02.030213 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-11e86fd5-d600-4b57-928e-859ffdb1d780 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:02.346046 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-11e86fd5-d600-4b57-928e-859ffdb1d780 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] 10.222.0.79 "POST /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6/action" status: 202 len: 0 microversion: 2.1 time: 0.326917 Jan 28 02:09:02.346730 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 250/505] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Jan 28 02:09:02 2022] POST /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6/action => generated 0 bytes in 329 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:09:02.351905 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-9611bbe2-009f-4099-b494-478f963a677f tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:02.352621 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-9611bbe2-009f-4099-b494-478f963a677f tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] [instance: 086c6296-168f-46fc-9ec4-8700b7c6ca9f] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:02.359523 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-9611bbe2-009f-4099-b494-478f963a677f tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:02.360101 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-9611bbe2-009f-4099-b494-478f963a677f tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:02.361086 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-9611bbe2-009f-4099-b494-478f963a677f tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:02.361546 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-9611bbe2-009f-4099-b494-478f963a677f tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:02.422965 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-9611bbe2-009f-4099-b494-478f963a677f tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14f6f890deb74eadab6b1ff4b6431036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e991e35dc5b463fbf9f08db0e72cf46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:02.430329 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-9611bbe2-009f-4099-b494-478f963a677f tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] 10.222.0.79 "GET /compute/v2.1/servers/086c6296-168f-46fc-9ec4-8700b7c6ca9f" status: 200 len: 1310 microversion: 2.1 time: 0.082310 Jan 28 02:09:02.430883 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 251/506] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:09:02 2022] GET /compute/v2.1/servers/086c6296-168f-46fc-9ec4-8700b7c6ca9f => generated 1310 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:09:02.435148 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-db5abd6f-beb1-41a4-babd-65cc14d71bf1 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:02.437603 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-db5abd6f-beb1-41a4-babd-65cc14d71bf1 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] [instance: ec5e47ac-761b-467f-958c-516a9f8bc3e6] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:02.442093 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-db5abd6f-beb1-41a4-babd-65cc14d71bf1 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:02.442527 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-db5abd6f-beb1-41a4-babd-65cc14d71bf1 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:02.443278 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-db5abd6f-beb1-41a4-babd-65cc14d71bf1 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:02.443701 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-db5abd6f-beb1-41a4-babd-65cc14d71bf1 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:02.592413 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-db5abd6f-beb1-41a4-babd-65cc14d71bf1 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd7039b8f074a13b2030a2bb7aaff94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc19a0f9c33f47f1b504bebbb0b2c931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:02.599401 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-1ebe80fa-6d9f-4168-a067-0287de835c6c tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "POST /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.322860 Jan 28 02:09:02.605748 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 256/507] 10.222.0.79 () {62 vars in 1363 bytes} [Fri Jan 28 02:09:01 2022] POST /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84/os-volume_attachments => generated 188 bytes in 1329 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 02:09:02.612378 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-26815480-ea56-4937-a5bd-492bf5dd94d9 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:02.613851 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-26815480-ea56-4937-a5bd-492bf5dd94d9 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: d5f49055-da38-486c-9f10-1658c64d46f5] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:02.617249 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-db5abd6f-beb1-41a4-babd-65cc14d71bf1 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] 10.222.0.79 "GET /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6" status: 200 len: 1555 microversion: 2.1 time: 0.185297 Jan 28 02:09:02.618146 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 252/508] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:09:02 2022] GET /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6 => generated 1555 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:09:02.627939 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-26815480-ea56-4937-a5bd-492bf5dd94d9 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:02.628785 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-26815480-ea56-4937-a5bd-492bf5dd94d9 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:02.633684 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-26815480-ea56-4937-a5bd-492bf5dd94d9 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:02.634694 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-26815480-ea56-4937-a5bd-492bf5dd94d9 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:02.779370 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-26815480-ea56-4937-a5bd-492bf5dd94d9 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acab2a0c4a0e48909317791a3de85b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abe012ba65845329098e0e06c54b9c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:02.789034 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-26815480-ea56-4937-a5bd-492bf5dd94d9 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "GET /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5" status: 200 len: 1713 microversion: 2.1 time: 0.183401 Jan 28 02:09:02.801444 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 257/509] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:09:02 2022] GET /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5 => generated 1713 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:09:03.020492 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-a4f92ace-1660-4960-8880-421bfee083c5 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:09:03.021800 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-a4f92ace-1660-4960-8880-421bfee083c5 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:03.040470 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-4ff2bdce-65af-49e1-948c-0ea1b1815058 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:03.043377 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-4ff2bdce-65af-49e1-948c-0ea1b1815058 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] [instance: 96b38440-c5bd-4838-bd1b-46312012607e] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:03.054593 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a4f92ace-1660-4960-8880-421bfee083c5 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:03.055040 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a4f92ace-1660-4960-8880-421bfee083c5 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:03.056061 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a4f92ace-1660-4960-8880-421bfee083c5 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:03.056377 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a4f92ace-1660-4960-8880-421bfee083c5 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:03.059960 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-4ff2bdce-65af-49e1-948c-0ea1b1815058 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:03.060423 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-4ff2bdce-65af-49e1-948c-0ea1b1815058 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:03.061239 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-4ff2bdce-65af-49e1-948c-0ea1b1815058 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:03.061663 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-4ff2bdce-65af-49e1-948c-0ea1b1815058 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:03.290693 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-4ff2bdce-65af-49e1-948c-0ea1b1815058 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b019715a14074e059730965913694e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b66ddee4c864aae90b738695dffbeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:03.298674 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-4ff2bdce-65af-49e1-948c-0ea1b1815058 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] 10.222.0.79 "GET /compute/v2.1/servers/96b38440-c5bd-4838-bd1b-46312012607e" status: 200 len: 1318 microversion: 2.1 time: 0.266655 Jan 28 02:09:03.299262 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 258/510] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:09:03 2022] GET /compute/v2.1/servers/96b38440-c5bd-4838-bd1b-46312012607e => generated 1318 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:09:03.425206 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-a4f92ace-1660-4960-8880-421bfee083c5 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "POST /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84/action" status: 202 len: 0 microversion: 2.20 time: 0.408607 Jan 28 02:09:03.426298 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 253/511] 10.222.0.79 () {62 vars in 1318 bytes} [Fri Jan 28 02:09:03 2022] POST /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84/action => generated 0 bytes in 411 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 28 02:09:03.434890 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-2a0a66fa-85bd-45e0-a0fb-ce091c5144b5 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:03.435845 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-2a0a66fa-85bd-45e0-a0fb-ce091c5144b5 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:03.444592 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-2a0a66fa-85bd-45e0-a0fb-ce091c5144b5 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:03.445470 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-2a0a66fa-85bd-45e0-a0fb-ce091c5144b5 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:03.446695 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-2a0a66fa-85bd-45e0-a0fb-ce091c5144b5 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:03.447654 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-2a0a66fa-85bd-45e0-a0fb-ce091c5144b5 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:03.459893 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-ad32d50f-2c0a-421f-9d9d-7c476d7f2e2c tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:03.463762 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-ad32d50f-2c0a-421f-9d9d-7c476d7f2e2c tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] [instance: 086c6296-168f-46fc-9ec4-8700b7c6ca9f] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:03.474836 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ad32d50f-2c0a-421f-9d9d-7c476d7f2e2c tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:03.475655 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ad32d50f-2c0a-421f-9d9d-7c476d7f2e2c tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:03.476871 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ad32d50f-2c0a-421f-9d9d-7c476d7f2e2c tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:03.477588 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ad32d50f-2c0a-421f-9d9d-7c476d7f2e2c tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:03.835265 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-ad32d50f-2c0a-421f-9d9d-7c476d7f2e2c tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14f6f890deb74eadab6b1ff4b6431036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e991e35dc5b463fbf9f08db0e72cf46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:03.844102 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-ad32d50f-2c0a-421f-9d9d-7c476d7f2e2c tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] 10.222.0.79 "GET /compute/v2.1/servers/086c6296-168f-46fc-9ec4-8700b7c6ca9f" status: 200 len: 1316 microversion: 2.1 time: 0.395916 Jan 28 02:09:03.849900 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 254/512] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:09:03 2022] GET /compute/v2.1/servers/086c6296-168f-46fc-9ec4-8700b7c6ca9f => generated 1316 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:09:03.861401 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-cf29c3e7-a0fa-4b25-bf13-4fef110df4c5 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:03.862716 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-cf29c3e7-a0fa-4b25-bf13-4fef110df4c5 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] [instance: ec5e47ac-761b-467f-958c-516a9f8bc3e6] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:03.869430 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-cf29c3e7-a0fa-4b25-bf13-4fef110df4c5 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:03.870117 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-cf29c3e7-a0fa-4b25-bf13-4fef110df4c5 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:03.871062 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-cf29c3e7-a0fa-4b25-bf13-4fef110df4c5 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:03.871647 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-cf29c3e7-a0fa-4b25-bf13-4fef110df4c5 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:04.025276 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-2a0a66fa-85bd-45e0-a0fb-ce091c5144b5 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:04.033600 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-2a0a66fa-85bd-45e0-a0fb-ce091c5144b5 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:04.035706 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-2a0a66fa-85bd-45e0-a0fb-ce091c5144b5 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:04.039402 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-2a0a66fa-85bd-45e0-a0fb-ce091c5144b5 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84" status: 200 len: 1750 microversion: 2.20 time: 0.608638 Jan 28 02:09:04.040369 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 259/513] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:09:03 2022] GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84 => generated 1750 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:09:04.214644 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-cf29c3e7-a0fa-4b25-bf13-4fef110df4c5 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd7039b8f074a13b2030a2bb7aaff94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc19a0f9c33f47f1b504bebbb0b2c931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:04.230828 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-cf29c3e7-a0fa-4b25-bf13-4fef110df4c5 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] 10.222.0.79 "GET /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6" status: 200 len: 1555 microversion: 2.1 time: 0.379582 Jan 28 02:09:04.231436 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 255/514] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:09:03 2022] GET /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6 => generated 1555 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:09:04.316133 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-dd48dfab-5e73-44ae-9e76-2a0cc0c13f08 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:04.318839 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-dd48dfab-5e73-44ae-9e76-2a0cc0c13f08 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] [instance: 96b38440-c5bd-4838-bd1b-46312012607e] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:04.325323 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-dd48dfab-5e73-44ae-9e76-2a0cc0c13f08 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:04.343910 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-dd48dfab-5e73-44ae-9e76-2a0cc0c13f08 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:04.345404 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-dd48dfab-5e73-44ae-9e76-2a0cc0c13f08 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:04.346043 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-dd48dfab-5e73-44ae-9e76-2a0cc0c13f08 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:04.867344 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-1198accf-f41e-4b32-9a5e-4afae95aa915 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:04.872565 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-1198accf-f41e-4b32-9a5e-4afae95aa915 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] [instance: 086c6296-168f-46fc-9ec4-8700b7c6ca9f] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:04.892818 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-1198accf-f41e-4b32-9a5e-4afae95aa915 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:04.896931 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-1198accf-f41e-4b32-9a5e-4afae95aa915 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:04.903335 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-1198accf-f41e-4b32-9a5e-4afae95aa915 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:04.904102 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-1198accf-f41e-4b32-9a5e-4afae95aa915 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:05.012785 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-dd48dfab-5e73-44ae-9e76-2a0cc0c13f08 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b019715a14074e059730965913694e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b66ddee4c864aae90b738695dffbeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:05.029318 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-dd48dfab-5e73-44ae-9e76-2a0cc0c13f08 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] 10.222.0.79 "GET /compute/v2.1/servers/96b38440-c5bd-4838-bd1b-46312012607e" status: 200 len: 1318 microversion: 2.1 time: 0.717762 Jan 28 02:09:05.031444 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 260/515] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:09:04 2022] GET /compute/v2.1/servers/96b38440-c5bd-4838-bd1b-46312012607e => generated 1318 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:09:05.059455 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-d0939edd-c892-4abf-8d8d-d350f95fec38 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:05.060090 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-d0939edd-c892-4abf-8d8d-d350f95fec38 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:05.078252 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-d0939edd-c892-4abf-8d8d-d350f95fec38 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:05.079290 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-d0939edd-c892-4abf-8d8d-d350f95fec38 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:05.082895 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-d0939edd-c892-4abf-8d8d-d350f95fec38 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:05.083916 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-d0939edd-c892-4abf-8d8d-d350f95fec38 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:05.411208 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-1198accf-f41e-4b32-9a5e-4afae95aa915 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14f6f890deb74eadab6b1ff4b6431036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e991e35dc5b463fbf9f08db0e72cf46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:05.429112 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-1198accf-f41e-4b32-9a5e-4afae95aa915 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] 10.222.0.79 "GET /compute/v2.1/servers/086c6296-168f-46fc-9ec4-8700b7c6ca9f" status: 200 len: 1358 microversion: 2.1 time: 0.565560 Jan 28 02:09:05.431073 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 256/516] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:09:04 2022] GET /compute/v2.1/servers/086c6296-168f-46fc-9ec4-8700b7c6ca9f => generated 1358 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:09:05.440506 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-7c9fdcf9-d3df-45e2-a5ca-a38352af0be0 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:05.441501 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-7c9fdcf9-d3df-45e2-a5ca-a38352af0be0 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] [instance: ec5e47ac-761b-467f-958c-516a9f8bc3e6] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:05.447645 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-7c9fdcf9-d3df-45e2-a5ca-a38352af0be0 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:05.448374 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-7c9fdcf9-d3df-45e2-a5ca-a38352af0be0 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:05.449987 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-7c9fdcf9-d3df-45e2-a5ca-a38352af0be0 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:05.450864 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-7c9fdcf9-d3df-45e2-a5ca-a38352af0be0 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:05.502860 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-d0939edd-c892-4abf-8d8d-d350f95fec38 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:05.513991 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-d0939edd-c892-4abf-8d8d-d350f95fec38 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:05.516301 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-d0939edd-c892-4abf-8d8d-d350f95fec38 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:05.518133 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-d0939edd-c892-4abf-8d8d-d350f95fec38 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84" status: 200 len: 1750 microversion: 2.20 time: 0.462239 Jan 28 02:09:05.519406 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 261/517] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:09:05 2022] GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84 => generated 1750 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 02:09:05.804864 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-7c9fdcf9-d3df-45e2-a5ca-a38352af0be0 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd7039b8f074a13b2030a2bb7aaff94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc19a0f9c33f47f1b504bebbb0b2c931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:05.813102 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-7c9fdcf9-d3df-45e2-a5ca-a38352af0be0 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] 10.222.0.79 "GET /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6" status: 200 len: 1555 microversion: 2.1 time: 0.379790 Jan 28 02:09:05.813750 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 257/518] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:09:05 2022] GET /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6 => generated 1555 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:09:06.055565 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-b109ca1a-8d0b-4ffb-a468-f7c2a909d686 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:06.057517 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-b109ca1a-8d0b-4ffb-a468-f7c2a909d686 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] [instance: 96b38440-c5bd-4838-bd1b-46312012607e] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:06.090740 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-b109ca1a-8d0b-4ffb-a468-f7c2a909d686 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:06.093730 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-b109ca1a-8d0b-4ffb-a468-f7c2a909d686 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:06.095886 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-b109ca1a-8d0b-4ffb-a468-f7c2a909d686 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:06.096348 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-b109ca1a-8d0b-4ffb-a468-f7c2a909d686 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:06.383038 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-b109ca1a-8d0b-4ffb-a468-f7c2a909d686 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b019715a14074e059730965913694e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b66ddee4c864aae90b738695dffbeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:06.392212 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-b109ca1a-8d0b-4ffb-a468-f7c2a909d686 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] 10.222.0.79 "GET /compute/v2.1/servers/96b38440-c5bd-4838-bd1b-46312012607e" status: 200 len: 1318 microversion: 2.1 time: 0.348790 Jan 28 02:09:06.402023 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 262/519] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:09:06 2022] GET /compute/v2.1/servers/96b38440-c5bd-4838-bd1b-46312012607e => generated 1318 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:09:06.451845 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-e9373cfa-1620-4dfb-bb51-89037f7a7942 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:06.453271 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-e9373cfa-1620-4dfb-bb51-89037f7a7942 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] [instance: 086c6296-168f-46fc-9ec4-8700b7c6ca9f] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:06.460062 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-e9373cfa-1620-4dfb-bb51-89037f7a7942 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:06.460577 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-e9373cfa-1620-4dfb-bb51-89037f7a7942 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:06.461416 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-e9373cfa-1620-4dfb-bb51-89037f7a7942 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:06.461903 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-e9373cfa-1620-4dfb-bb51-89037f7a7942 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:06.540469 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-112e3e94-c683-4677-9fb5-4b33319cce41 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:06.540949 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-112e3e94-c683-4677-9fb5-4b33319cce41 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:06.550862 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-112e3e94-c683-4677-9fb5-4b33319cce41 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:06.551290 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-112e3e94-c683-4677-9fb5-4b33319cce41 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:06.552107 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-112e3e94-c683-4677-9fb5-4b33319cce41 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:06.557224 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-112e3e94-c683-4677-9fb5-4b33319cce41 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:06.827262 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-112e3e94-c683-4677-9fb5-4b33319cce41 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:06.838542 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-112e3e94-c683-4677-9fb5-4b33319cce41 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:06.860616 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-112e3e94-c683-4677-9fb5-4b33319cce41 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:06.863555 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-112e3e94-c683-4677-9fb5-4b33319cce41 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84" status: 200 len: 1750 microversion: 2.20 time: 0.328214 Jan 28 02:09:06.870314 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 263/520] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:09:06 2022] GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84 => generated 1750 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:09:06.877874 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [req-d0c042e1-dacc-47f8-814b-47e67821fbe3 req-d6fb6252-18c3-42f9-8a29-1e325f88e482 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "086c6296-168f-46fc-9ec4-8700b7c6ca9f", "tag": "deb20626-b237-4650-a93b-12a633f6daa5"}]} {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:09:06.881197 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:09:06.881197 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: warnings.warn(msg) Jan 28 02:09:06.888645 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-e9373cfa-1620-4dfb-bb51-89037f7a7942 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14f6f890deb74eadab6b1ff4b6431036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e991e35dc5b463fbf9f08db0e72cf46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:06.895001 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [req-d0c042e1-dacc-47f8-814b-47e67821fbe3 req-d6fb6252-18c3-42f9-8a29-1e325f88e482 service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:06.895508 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [req-d0c042e1-dacc-47f8-814b-47e67821fbe3 req-d6fb6252-18c3-42f9-8a29-1e325f88e482 service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:06.898786 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-e9373cfa-1620-4dfb-bb51-89037f7a7942 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] 10.222.0.79 "GET /compute/v2.1/servers/086c6296-168f-46fc-9ec4-8700b7c6ca9f" status: 200 len: 1358 microversion: 2.1 time: 0.453333 Jan 28 02:09:06.900063 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 258/521] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:09:06 2022] GET /compute/v2.1/servers/086c6296-168f-46fc-9ec4-8700b7c6ca9f => generated 1358 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:09:06.914123 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-a48d8da7-1d37-4a95-8560-2005671b6f82 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:06.916379 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-a48d8da7-1d37-4a95-8560-2005671b6f82 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] [instance: ec5e47ac-761b-467f-958c-516a9f8bc3e6] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:06.921870 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.compute.server_external_events [req-d0c042e1-dacc-47f8-814b-47e67821fbe3 req-d6fb6252-18c3-42f9-8a29-1e325f88e482 service nova] Creating event network-changed:deb20626-b237-4650-a93b-12a633f6daa5 for instance 086c6296-168f-46fc-9ec4-8700b7c6ca9f on hv-cinder-82497 Jan 28 02:09:06.924957 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [req-d0c042e1-dacc-47f8-814b-47e67821fbe3 req-d6fb6252-18c3-42f9-8a29-1e325f88e482 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057402 Jan 28 02:09:06.925999 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 264/522] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Jan 28 02:09:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:09:06.926376 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a48d8da7-1d37-4a95-8560-2005671b6f82 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:06.926886 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a48d8da7-1d37-4a95-8560-2005671b6f82 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:06.928368 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a48d8da7-1d37-4a95-8560-2005671b6f82 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:06.928872 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a48d8da7-1d37-4a95-8560-2005671b6f82 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:07.192825 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-a48d8da7-1d37-4a95-8560-2005671b6f82 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd7039b8f074a13b2030a2bb7aaff94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc19a0f9c33f47f1b504bebbb0b2c931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:07.201624 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-a48d8da7-1d37-4a95-8560-2005671b6f82 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] 10.222.0.79 "GET /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6" status: 200 len: 1555 microversion: 2.1 time: 0.300114 Jan 28 02:09:07.212621 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 259/523] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:09:06 2022] GET /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6 => generated 1555 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:09:07.411554 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-0900a0e5-fdcb-460f-b172-a2e8d327c492 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:07.412742 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-0900a0e5-fdcb-460f-b172-a2e8d327c492 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] [instance: 96b38440-c5bd-4838-bd1b-46312012607e] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:07.430068 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-0900a0e5-fdcb-460f-b172-a2e8d327c492 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:07.430691 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-0900a0e5-fdcb-460f-b172-a2e8d327c492 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:07.431559 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-0900a0e5-fdcb-460f-b172-a2e8d327c492 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:07.432084 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-0900a0e5-fdcb-460f-b172-a2e8d327c492 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:07.606705 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-0900a0e5-fdcb-460f-b172-a2e8d327c492 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b019715a14074e059730965913694e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b66ddee4c864aae90b738695dffbeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:07.615872 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-0900a0e5-fdcb-460f-b172-a2e8d327c492 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] 10.222.0.79 "GET /compute/v2.1/servers/96b38440-c5bd-4838-bd1b-46312012607e" status: 200 len: 1318 microversion: 2.1 time: 0.208737 Jan 28 02:09:07.616417 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 265/524] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:09:07 2022] GET /compute/v2.1/servers/96b38440-c5bd-4838-bd1b-46312012607e => generated 1318 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:09:07.882811 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-a3c32e3c-4493-4318-abd5-057a8d1b52c3 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:07.884114 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-a3c32e3c-4493-4318-abd5-057a8d1b52c3 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:07.903663 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a3c32e3c-4493-4318-abd5-057a8d1b52c3 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:07.904132 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a3c32e3c-4493-4318-abd5-057a8d1b52c3 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:07.904918 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a3c32e3c-4493-4318-abd5-057a8d1b52c3 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:07.905350 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a3c32e3c-4493-4318-abd5-057a8d1b52c3 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:07.917970 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-b3bf5f79-f582-4dfc-8fba-f118e360a5a1 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:07.919119 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-b3bf5f79-f582-4dfc-8fba-f118e360a5a1 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] [instance: 086c6296-168f-46fc-9ec4-8700b7c6ca9f] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:07.931222 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-b3bf5f79-f582-4dfc-8fba-f118e360a5a1 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:07.931673 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-b3bf5f79-f582-4dfc-8fba-f118e360a5a1 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:07.932492 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-b3bf5f79-f582-4dfc-8fba-f118e360a5a1 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:07.932921 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-b3bf5f79-f582-4dfc-8fba-f118e360a5a1 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:08.123022 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-a3c32e3c-4493-4318-abd5-057a8d1b52c3 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:08.136670 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-a3c32e3c-4493-4318-abd5-057a8d1b52c3 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:08.138274 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-b3bf5f79-f582-4dfc-8fba-f118e360a5a1 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14f6f890deb74eadab6b1ff4b6431036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e991e35dc5b463fbf9f08db0e72cf46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:08.139607 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-a3c32e3c-4493-4318-abd5-057a8d1b52c3 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:08.142491 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-a3c32e3c-4493-4318-abd5-057a8d1b52c3 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84" status: 200 len: 1750 microversion: 2.20 time: 0.263497 Jan 28 02:09:08.143739 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 260/525] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:09:07 2022] GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84 => generated 1750 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:09:08.165008 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-b3bf5f79-f582-4dfc-8fba-f118e360a5a1 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] 10.222.0.79 "GET /compute/v2.1/servers/086c6296-168f-46fc-9ec4-8700b7c6ca9f" status: 200 len: 1358 microversion: 2.1 time: 0.249619 Jan 28 02:09:08.165008 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 266/526] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:09:07 2022] GET /compute/v2.1/servers/086c6296-168f-46fc-9ec4-8700b7c6ca9f => generated 1358 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:09:08.226895 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-e0cd8cb0-07e2-4528-843d-a4ef60d54568 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:08.227620 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-e0cd8cb0-07e2-4528-843d-a4ef60d54568 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] [instance: ec5e47ac-761b-467f-958c-516a9f8bc3e6] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:08.234379 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-e0cd8cb0-07e2-4528-843d-a4ef60d54568 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:08.234916 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-e0cd8cb0-07e2-4528-843d-a4ef60d54568 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:08.235799 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-e0cd8cb0-07e2-4528-843d-a4ef60d54568 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:08.236634 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-e0cd8cb0-07e2-4528-843d-a4ef60d54568 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:08.389792 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-e0cd8cb0-07e2-4528-843d-a4ef60d54568 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd7039b8f074a13b2030a2bb7aaff94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc19a0f9c33f47f1b504bebbb0b2c931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:08.398644 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-e0cd8cb0-07e2-4528-843d-a4ef60d54568 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] 10.222.0.79 "GET /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6" status: 200 len: 1555 microversion: 2.1 time: 0.175786 Jan 28 02:09:08.399339 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 261/527] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:09:08 2022] GET /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6 => generated 1555 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:09:08.632894 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-69cb61c6-7090-44ce-a885-9e0907f3b610 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:08.633487 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-69cb61c6-7090-44ce-a885-9e0907f3b610 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] [instance: 96b38440-c5bd-4838-bd1b-46312012607e] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:08.639383 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-69cb61c6-7090-44ce-a885-9e0907f3b610 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:08.640105 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-69cb61c6-7090-44ce-a885-9e0907f3b610 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:08.640733 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-69cb61c6-7090-44ce-a885-9e0907f3b610 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:08.641324 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-69cb61c6-7090-44ce-a885-9e0907f3b610 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:08.783165 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-69cb61c6-7090-44ce-a885-9e0907f3b610 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b019715a14074e059730965913694e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b66ddee4c864aae90b738695dffbeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:08.790498 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-69cb61c6-7090-44ce-a885-9e0907f3b610 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] 10.222.0.79 "GET /compute/v2.1/servers/96b38440-c5bd-4838-bd1b-46312012607e" status: 200 len: 1318 microversion: 2.1 time: 0.161282 Jan 28 02:09:08.791064 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 267/528] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:09:08 2022] GET /compute/v2.1/servers/96b38440-c5bd-4838-bd1b-46312012607e => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:09:09.164409 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-a53d059f-8118-41ea-8eb4-afd1e33625e5 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:09.165015 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-a53d059f-8118-41ea-8eb4-afd1e33625e5 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:09.170928 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a53d059f-8118-41ea-8eb4-afd1e33625e5 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:09.172305 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a53d059f-8118-41ea-8eb4-afd1e33625e5 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:09.173445 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a53d059f-8118-41ea-8eb4-afd1e33625e5 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:09.174055 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a53d059f-8118-41ea-8eb4-afd1e33625e5 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:09.181649 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-adc6dc92-05b3-4a5f-b7f5-cf855253b341 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:09.182260 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-adc6dc92-05b3-4a5f-b7f5-cf855253b341 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] [instance: 086c6296-168f-46fc-9ec4-8700b7c6ca9f] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:09.189969 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-adc6dc92-05b3-4a5f-b7f5-cf855253b341 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:09.195643 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-adc6dc92-05b3-4a5f-b7f5-cf855253b341 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:09.195643 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-adc6dc92-05b3-4a5f-b7f5-cf855253b341 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:09.195643 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-adc6dc92-05b3-4a5f-b7f5-cf855253b341 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:09.391505 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-adc6dc92-05b3-4a5f-b7f5-cf855253b341 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14f6f890deb74eadab6b1ff4b6431036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e991e35dc5b463fbf9f08db0e72cf46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:09.393355 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-a53d059f-8118-41ea-8eb4-afd1e33625e5 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:09.402545 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-adc6dc92-05b3-4a5f-b7f5-cf855253b341 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] 10.222.0.79 "GET /compute/v2.1/servers/086c6296-168f-46fc-9ec4-8700b7c6ca9f" status: 200 len: 1358 microversion: 2.1 time: 0.224590 Jan 28 02:09:09.402969 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-a53d059f-8118-41ea-8eb4-afd1e33625e5 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:09.412271 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-a53d059f-8118-41ea-8eb4-afd1e33625e5 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:09.413865 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-a53d059f-8118-41ea-8eb4-afd1e33625e5 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84" status: 200 len: 1750 microversion: 2.20 time: 0.253254 Jan 28 02:09:09.414517 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 268/529] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:09:09 2022] GET /compute/v2.1/servers/086c6296-168f-46fc-9ec4-8700b7c6ca9f => generated 1358 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:09:09.417400 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 262/530] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:09:09 2022] GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84 => generated 1750 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:09:09.430981 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-3a33e47a-3d5e-4b5d-bde8-a79df384db92 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:09.431668 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-3a33e47a-3d5e-4b5d-bde8-a79df384db92 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] [instance: ec5e47ac-761b-467f-958c-516a9f8bc3e6] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:09.438517 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-3a33e47a-3d5e-4b5d-bde8-a79df384db92 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:09.439042 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-3a33e47a-3d5e-4b5d-bde8-a79df384db92 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:09.439877 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-3a33e47a-3d5e-4b5d-bde8-a79df384db92 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:09.440582 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-3a33e47a-3d5e-4b5d-bde8-a79df384db92 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:09.579911 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-3a33e47a-3d5e-4b5d-bde8-a79df384db92 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd7039b8f074a13b2030a2bb7aaff94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc19a0f9c33f47f1b504bebbb0b2c931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:09.588481 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-3a33e47a-3d5e-4b5d-bde8-a79df384db92 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] 10.222.0.79 "GET /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6" status: 200 len: 1555 microversion: 2.1 time: 0.172054 Jan 28 02:09:09.599785 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 269/531] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:09:09 2022] GET /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6 => generated 1555 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:09:09.808814 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-14bd3bbc-b0c1-4ada-b023-3ed952f49f94 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:09.809409 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-14bd3bbc-b0c1-4ada-b023-3ed952f49f94 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] [instance: 96b38440-c5bd-4838-bd1b-46312012607e] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:09.815326 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-14bd3bbc-b0c1-4ada-b023-3ed952f49f94 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:09.817043 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-14bd3bbc-b0c1-4ada-b023-3ed952f49f94 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:09.817043 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-14bd3bbc-b0c1-4ada-b023-3ed952f49f94 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:09.817043 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-14bd3bbc-b0c1-4ada-b023-3ed952f49f94 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:09.986925 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-14bd3bbc-b0c1-4ada-b023-3ed952f49f94 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b019715a14074e059730965913694e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b66ddee4c864aae90b738695dffbeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:09.995080 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-14bd3bbc-b0c1-4ada-b023-3ed952f49f94 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] 10.222.0.79 "GET /compute/v2.1/servers/96b38440-c5bd-4838-bd1b-46312012607e" status: 200 len: 1318 microversion: 2.1 time: 0.189804 Jan 28 02:09:09.995662 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 263/532] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:09:09 2022] GET /compute/v2.1/servers/96b38440-c5bd-4838-bd1b-46312012607e => generated 1318 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:09:10.422562 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-205f3b83-4e15-43b1-85a4-e8cc2d36e0b1 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:10.423175 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-205f3b83-4e15-43b1-85a4-e8cc2d36e0b1 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] [instance: 086c6296-168f-46fc-9ec4-8700b7c6ca9f] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:10.429661 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-205f3b83-4e15-43b1-85a4-e8cc2d36e0b1 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:10.430403 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-205f3b83-4e15-43b1-85a4-e8cc2d36e0b1 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:10.431353 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-205f3b83-4e15-43b1-85a4-e8cc2d36e0b1 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:10.433701 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-205f3b83-4e15-43b1-85a4-e8cc2d36e0b1 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:10.439433 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-074b7171-d85d-48c2-87aa-a9ed6e0f8890 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:10.440124 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-074b7171-d85d-48c2-87aa-a9ed6e0f8890 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:10.450617 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-074b7171-d85d-48c2-87aa-a9ed6e0f8890 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:10.452419 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-074b7171-d85d-48c2-87aa-a9ed6e0f8890 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:10.453931 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-074b7171-d85d-48c2-87aa-a9ed6e0f8890 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:10.458446 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-074b7171-d85d-48c2-87aa-a9ed6e0f8890 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:10.689324 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-205f3b83-4e15-43b1-85a4-e8cc2d36e0b1 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14f6f890deb74eadab6b1ff4b6431036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e991e35dc5b463fbf9f08db0e72cf46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:10.696853 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-074b7171-d85d-48c2-87aa-a9ed6e0f8890 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:10.701794 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-205f3b83-4e15-43b1-85a4-e8cc2d36e0b1 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] 10.222.0.79 "GET /compute/v2.1/servers/086c6296-168f-46fc-9ec4-8700b7c6ca9f" status: 200 len: 1358 microversion: 2.1 time: 0.284160 Jan 28 02:09:10.702981 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 270/533] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:09:10 2022] GET /compute/v2.1/servers/086c6296-168f-46fc-9ec4-8700b7c6ca9f => generated 1358 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:09:10.706203 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-074b7171-d85d-48c2-87aa-a9ed6e0f8890 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:10.708066 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-074b7171-d85d-48c2-87aa-a9ed6e0f8890 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:10.709610 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-074b7171-d85d-48c2-87aa-a9ed6e0f8890 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84" status: 200 len: 1750 microversion: 2.20 time: 0.274828 Jan 28 02:09:10.710786 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 264/534] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:09:10 2022] GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84 => generated 1750 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 02:09:10.730085 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-6870350f-e196-4690-b724-d4f218b29585 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:10.730369 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-6870350f-e196-4690-b724-d4f218b29585 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] [instance: ec5e47ac-761b-467f-958c-516a9f8bc3e6] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:10.739410 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-6870350f-e196-4690-b724-d4f218b29585 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:10.739790 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-6870350f-e196-4690-b724-d4f218b29585 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:10.740719 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-6870350f-e196-4690-b724-d4f218b29585 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:10.741327 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-6870350f-e196-4690-b724-d4f218b29585 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:10.797364 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [req-87b79450-2bce-4e4f-923d-ab70b3f0f7d4 req-2f105f6a-0110-4ac7-a4b1-7bbb9399dec6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96b38440-c5bd-4838-bd1b-46312012607e", "name": "network-vif-plugged", "status": "completed", "tag": "8d7133bd-248c-438b-adfd-1ef3f2765032"}]} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:09:10.799463 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:09:10.799463 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: warnings.warn(msg) Jan 28 02:09:10.812847 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-87b79450-2bce-4e4f-923d-ab70b3f0f7d4 req-2f105f6a-0110-4ac7-a4b1-7bbb9399dec6 service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:10.817945 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-87b79450-2bce-4e4f-923d-ab70b3f0f7d4 req-2f105f6a-0110-4ac7-a4b1-7bbb9399dec6 service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:10.830393 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.compute.server_external_events [req-87b79450-2bce-4e4f-923d-ab70b3f0f7d4 req-2f105f6a-0110-4ac7-a4b1-7bbb9399dec6 service nova] Creating event network-vif-plugged:8d7133bd-248c-438b-adfd-1ef3f2765032 for instance 96b38440-c5bd-4838-bd1b-46312012607e on hv-cinder-82497 Jan 28 02:09:10.851177 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [req-87b79450-2bce-4e4f-923d-ab70b3f0f7d4 req-2f105f6a-0110-4ac7-a4b1-7bbb9399dec6 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058403 Jan 28 02:09:10.852092 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 265/535] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Jan 28 02:09:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 02:09:10.914676 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-6870350f-e196-4690-b724-d4f218b29585 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd7039b8f074a13b2030a2bb7aaff94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc19a0f9c33f47f1b504bebbb0b2c931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:10.924630 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-6870350f-e196-4690-b724-d4f218b29585 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] 10.222.0.79 "GET /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6" status: 200 len: 1555 microversion: 2.1 time: 0.202469 Jan 28 02:09:10.925727 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 271/536] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:09:10 2022] GET /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6 => generated 1555 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:09:11.013156 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-41640b34-d4af-40dd-b473-374b4f73fad6 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:11.014126 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-41640b34-d4af-40dd-b473-374b4f73fad6 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] [instance: 96b38440-c5bd-4838-bd1b-46312012607e] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:11.029493 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-41640b34-d4af-40dd-b473-374b4f73fad6 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:11.032375 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-41640b34-d4af-40dd-b473-374b4f73fad6 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:11.033332 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-41640b34-d4af-40dd-b473-374b4f73fad6 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:11.033913 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-41640b34-d4af-40dd-b473-374b4f73fad6 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:11.177784 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-41640b34-d4af-40dd-b473-374b4f73fad6 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b019715a14074e059730965913694e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b66ddee4c864aae90b738695dffbeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:11.185993 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-41640b34-d4af-40dd-b473-374b4f73fad6 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] 10.222.0.79 "GET /compute/v2.1/servers/96b38440-c5bd-4838-bd1b-46312012607e" status: 200 len: 1318 microversion: 2.1 time: 0.177225 Jan 28 02:09:11.190388 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 266/537] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:09:11 2022] GET /compute/v2.1/servers/96b38440-c5bd-4838-bd1b-46312012607e => generated 1318 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:09:11.719236 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-65107f19-f279-4c22-b7ef-fcd33d1b8f69 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:11.735286 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-65107f19-f279-4c22-b7ef-fcd33d1b8f69 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] [instance: 086c6296-168f-46fc-9ec4-8700b7c6ca9f] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:11.735286 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-65107f19-f279-4c22-b7ef-fcd33d1b8f69 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:11.735286 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-65107f19-f279-4c22-b7ef-fcd33d1b8f69 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:11.735286 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-65107f19-f279-4c22-b7ef-fcd33d1b8f69 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:11.735712 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-65107f19-f279-4c22-b7ef-fcd33d1b8f69 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:11.735814 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-e1d82b8f-0623-4129-83cb-ba845116fc24 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:11.736446 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-e1d82b8f-0623-4129-83cb-ba845116fc24 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:11.745449 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-e1d82b8f-0623-4129-83cb-ba845116fc24 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:11.745901 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-e1d82b8f-0623-4129-83cb-ba845116fc24 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:11.746687 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-e1d82b8f-0623-4129-83cb-ba845116fc24 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:11.747117 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-e1d82b8f-0623-4129-83cb-ba845116fc24 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:11.943399 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-e1d82b8f-0623-4129-83cb-ba845116fc24 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:11.951716 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-e1d82b8f-0623-4129-83cb-ba845116fc24 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:11.958962 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-e1d82b8f-0623-4129-83cb-ba845116fc24 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:11.958962 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-e1d82b8f-0623-4129-83cb-ba845116fc24 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84" status: 200 len: 1750 microversion: 2.20 time: 0.227357 Jan 28 02:09:11.958962 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 267/538] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:09:11 2022] GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84 => generated 1750 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:09:11.976846 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-d3f847f8-8e09-402c-b383-7f2157bb5bde tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:11.979219 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-d3f847f8-8e09-402c-b383-7f2157bb5bde tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] [instance: ec5e47ac-761b-467f-958c-516a9f8bc3e6] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:11.990119 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-d3f847f8-8e09-402c-b383-7f2157bb5bde tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:11.990567 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-d3f847f8-8e09-402c-b383-7f2157bb5bde tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:11.991345 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-d3f847f8-8e09-402c-b383-7f2157bb5bde tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:11.991800 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-d3f847f8-8e09-402c-b383-7f2157bb5bde tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:11.996368 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-65107f19-f279-4c22-b7ef-fcd33d1b8f69 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14f6f890deb74eadab6b1ff4b6431036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e991e35dc5b463fbf9f08db0e72cf46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:12.006401 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-65107f19-f279-4c22-b7ef-fcd33d1b8f69 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] 10.222.0.79 "GET /compute/v2.1/servers/086c6296-168f-46fc-9ec4-8700b7c6ca9f" status: 200 len: 1358 microversion: 2.1 time: 0.291524 Jan 28 02:09:12.006988 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 272/539] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:09:11 2022] GET /compute/v2.1/servers/086c6296-168f-46fc-9ec4-8700b7c6ca9f => generated 1358 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:09:12.169974 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-d3f847f8-8e09-402c-b383-7f2157bb5bde tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd7039b8f074a13b2030a2bb7aaff94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc19a0f9c33f47f1b504bebbb0b2c931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:12.178258 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-d3f847f8-8e09-402c-b383-7f2157bb5bde tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] 10.222.0.79 "GET /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6" status: 200 len: 1555 microversion: 2.1 time: 0.205273 Jan 28 02:09:12.180047 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 268/540] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:09:11 2022] GET /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6 => generated 1555 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:09:12.203570 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-894ee29f-5cd2-4e88-b1a1-d713adf7d5ad tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:12.204306 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-894ee29f-5cd2-4e88-b1a1-d713adf7d5ad tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] [instance: 96b38440-c5bd-4838-bd1b-46312012607e] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:12.211097 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-894ee29f-5cd2-4e88-b1a1-d713adf7d5ad tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:12.211590 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-894ee29f-5cd2-4e88-b1a1-d713adf7d5ad tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:12.212476 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-894ee29f-5cd2-4e88-b1a1-d713adf7d5ad tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:12.212994 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-894ee29f-5cd2-4e88-b1a1-d713adf7d5ad tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:12.352006 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-894ee29f-5cd2-4e88-b1a1-d713adf7d5ad tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b019715a14074e059730965913694e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b66ddee4c864aae90b738695dffbeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:12.360781 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-894ee29f-5cd2-4e88-b1a1-d713adf7d5ad tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] 10.222.0.79 "GET /compute/v2.1/servers/96b38440-c5bd-4838-bd1b-46312012607e" status: 200 len: 1318 microversion: 2.1 time: 0.161088 Jan 28 02:09:12.371792 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 273/541] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:09:12 2022] GET /compute/v2.1/servers/96b38440-c5bd-4838-bd1b-46312012607e => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:09:12.976955 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-bafa73b8-b3ef-4d67-9bab-2e103dea710b tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:12.978502 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-bafa73b8-b3ef-4d67-9bab-2e103dea710b tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:12.987053 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-bafa73b8-b3ef-4d67-9bab-2e103dea710b tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:12.988705 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-bafa73b8-b3ef-4d67-9bab-2e103dea710b tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:12.989595 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-bafa73b8-b3ef-4d67-9bab-2e103dea710b tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:12.990376 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-bafa73b8-b3ef-4d67-9bab-2e103dea710b tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:13.031102 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-0158d53e-e0bb-4da3-a213-e7f55dd189fc tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:13.031102 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-0158d53e-e0bb-4da3-a213-e7f55dd189fc tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] [instance: 086c6296-168f-46fc-9ec4-8700b7c6ca9f] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:13.035905 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-0158d53e-e0bb-4da3-a213-e7f55dd189fc tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:13.036443 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-0158d53e-e0bb-4da3-a213-e7f55dd189fc tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:13.037242 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-0158d53e-e0bb-4da3-a213-e7f55dd189fc tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:13.037664 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-0158d53e-e0bb-4da3-a213-e7f55dd189fc tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:13.163036 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-bafa73b8-b3ef-4d67-9bab-2e103dea710b tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:13.172860 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-bafa73b8-b3ef-4d67-9bab-2e103dea710b tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:13.174571 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-bafa73b8-b3ef-4d67-9bab-2e103dea710b tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:13.175845 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-bafa73b8-b3ef-4d67-9bab-2e103dea710b tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84" status: 200 len: 1750 microversion: 2.20 time: 0.202531 Jan 28 02:09:13.176746 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 269/542] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:09:12 2022] GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84 => generated 1750 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:09:13.196706 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-8826ce08-b8ef-41f7-82cb-7c52f125fadc tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:13.197144 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-8826ce08-b8ef-41f7-82cb-7c52f125fadc tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] [instance: ec5e47ac-761b-467f-958c-516a9f8bc3e6] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:13.209229 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-8826ce08-b8ef-41f7-82cb-7c52f125fadc tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:13.209570 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-8826ce08-b8ef-41f7-82cb-7c52f125fadc tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:13.210381 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-8826ce08-b8ef-41f7-82cb-7c52f125fadc tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:13.210924 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-8826ce08-b8ef-41f7-82cb-7c52f125fadc tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:13.224288 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-0158d53e-e0bb-4da3-a213-e7f55dd189fc tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14f6f890deb74eadab6b1ff4b6431036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e991e35dc5b463fbf9f08db0e72cf46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:13.234087 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-0158d53e-e0bb-4da3-a213-e7f55dd189fc tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] 10.222.0.79 "GET /compute/v2.1/servers/086c6296-168f-46fc-9ec4-8700b7c6ca9f" status: 200 len: 1358 microversion: 2.1 time: 0.212181 Jan 28 02:09:13.235330 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 274/543] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:09:13 2022] GET /compute/v2.1/servers/086c6296-168f-46fc-9ec4-8700b7c6ca9f => generated 1358 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:09:13.344512 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-8826ce08-b8ef-41f7-82cb-7c52f125fadc tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd7039b8f074a13b2030a2bb7aaff94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc19a0f9c33f47f1b504bebbb0b2c931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:13.352134 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-8826ce08-b8ef-41f7-82cb-7c52f125fadc tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] 10.222.0.79 "GET /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6" status: 200 len: 1555 microversion: 2.1 time: 0.159714 Jan 28 02:09:13.352699 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 270/544] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:09:13 2022] GET /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6 => generated 1555 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:09:13.377094 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-632cb5f9-b47a-43e7-8b08-f0dac6dba954 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:13.377619 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-632cb5f9-b47a-43e7-8b08-f0dac6dba954 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] [instance: 96b38440-c5bd-4838-bd1b-46312012607e] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:13.383536 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-632cb5f9-b47a-43e7-8b08-f0dac6dba954 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:13.384156 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-632cb5f9-b47a-43e7-8b08-f0dac6dba954 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:13.384956 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-632cb5f9-b47a-43e7-8b08-f0dac6dba954 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:13.385396 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-632cb5f9-b47a-43e7-8b08-f0dac6dba954 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:13.507260 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-632cb5f9-b47a-43e7-8b08-f0dac6dba954 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b019715a14074e059730965913694e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b66ddee4c864aae90b738695dffbeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:13.514595 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-632cb5f9-b47a-43e7-8b08-f0dac6dba954 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] 10.222.0.79 "GET /compute/v2.1/servers/96b38440-c5bd-4838-bd1b-46312012607e" status: 200 len: 1318 microversion: 2.1 time: 0.141193 Jan 28 02:09:13.515905 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 275/545] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:09:13 2022] GET /compute/v2.1/servers/96b38440-c5bd-4838-bd1b-46312012607e => generated 1318 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:09:14.197915 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-f8de6d02-34c1-408f-87ab-cbc8d429c9e0 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:14.201762 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-f8de6d02-34c1-408f-87ab-cbc8d429c9e0 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:14.205246 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f8de6d02-34c1-408f-87ab-cbc8d429c9e0 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:14.205691 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f8de6d02-34c1-408f-87ab-cbc8d429c9e0 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:14.206486 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f8de6d02-34c1-408f-87ab-cbc8d429c9e0 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:14.207791 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f8de6d02-34c1-408f-87ab-cbc8d429c9e0 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:14.251736 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-d28685e1-8a56-491c-b4bf-0bd4d1e36fdb tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:14.252378 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-d28685e1-8a56-491c-b4bf-0bd4d1e36fdb tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] [instance: 086c6296-168f-46fc-9ec4-8700b7c6ca9f] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:14.267228 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-d28685e1-8a56-491c-b4bf-0bd4d1e36fdb tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:14.268035 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-d28685e1-8a56-491c-b4bf-0bd4d1e36fdb tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:14.272071 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-d28685e1-8a56-491c-b4bf-0bd4d1e36fdb tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:14.272071 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-d28685e1-8a56-491c-b4bf-0bd4d1e36fdb tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:14.475553 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-f8de6d02-34c1-408f-87ab-cbc8d429c9e0 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:14.484997 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-f8de6d02-34c1-408f-87ab-cbc8d429c9e0 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:14.486547 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-f8de6d02-34c1-408f-87ab-cbc8d429c9e0 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:14.487955 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-f8de6d02-34c1-408f-87ab-cbc8d429c9e0 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84" status: 200 len: 1752 microversion: 2.20 time: 0.293843 Jan 28 02:09:14.488553 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 271/546] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:09:14 2022] GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84 => generated 1752 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:09:14.489979 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-d28685e1-8a56-491c-b4bf-0bd4d1e36fdb tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14f6f890deb74eadab6b1ff4b6431036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e991e35dc5b463fbf9f08db0e72cf46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:14.493526 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-129021de-daec-4fe0-a25d-ac242affa2fc tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:14.494153 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-129021de-daec-4fe0-a25d-ac242affa2fc tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] [instance: ec5e47ac-761b-467f-958c-516a9f8bc3e6] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:14.501090 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-129021de-daec-4fe0-a25d-ac242affa2fc tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:14.501344 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-d28685e1-8a56-491c-b4bf-0bd4d1e36fdb tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] 10.222.0.79 "GET /compute/v2.1/servers/086c6296-168f-46fc-9ec4-8700b7c6ca9f" status: 200 len: 1358 microversion: 2.1 time: 0.254342 Jan 28 02:09:14.501484 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-129021de-daec-4fe0-a25d-ac242affa2fc tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:14.501884 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 276/547] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:09:14 2022] GET /compute/v2.1/servers/086c6296-168f-46fc-9ec4-8700b7c6ca9f => generated 1358 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:09:14.502270 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-129021de-daec-4fe0-a25d-ac242affa2fc tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:14.502702 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-129021de-daec-4fe0-a25d-ac242affa2fc tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:14.532944 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-84a26a4b-bcd8-4a5b-a213-62324d984baf tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:14.534703 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-84a26a4b-bcd8-4a5b-a213-62324d984baf tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] [instance: 96b38440-c5bd-4838-bd1b-46312012607e] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:14.547318 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-84a26a4b-bcd8-4a5b-a213-62324d984baf tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:14.548475 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-84a26a4b-bcd8-4a5b-a213-62324d984baf tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:14.549304 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-84a26a4b-bcd8-4a5b-a213-62324d984baf tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:14.549949 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-84a26a4b-bcd8-4a5b-a213-62324d984baf tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:14.675312 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-129021de-daec-4fe0-a25d-ac242affa2fc tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd7039b8f074a13b2030a2bb7aaff94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc19a0f9c33f47f1b504bebbb0b2c931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:14.683369 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-129021de-daec-4fe0-a25d-ac242affa2fc tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] 10.222.0.79 "GET /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6" status: 200 len: 1555 microversion: 2.1 time: 0.193788 Jan 28 02:09:14.683956 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 272/548] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:09:14 2022] GET /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6 => generated 1555 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:09:14.712281 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-84a26a4b-bcd8-4a5b-a213-62324d984baf tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b019715a14074e059730965913694e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b66ddee4c864aae90b738695dffbeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:14.722029 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-84a26a4b-bcd8-4a5b-a213-62324d984baf tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] 10.222.0.79 "GET /compute/v2.1/servers/96b38440-c5bd-4838-bd1b-46312012607e" status: 200 len: 1318 microversion: 2.1 time: 0.193562 Jan 28 02:09:14.722600 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 277/549] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:09:14 2022] GET /compute/v2.1/servers/96b38440-c5bd-4838-bd1b-46312012607e => generated 1318 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:09:15.509710 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-83a83ca1-ea60-4298-90b9-11794e83a51e tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:15.511090 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-83a83ca1-ea60-4298-90b9-11794e83a51e tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:15.518838 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-08f4793c-070f-4d72-b41e-7b7d5f196659 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:15.519470 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-08f4793c-070f-4d72-b41e-7b7d5f196659 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] [instance: 086c6296-168f-46fc-9ec4-8700b7c6ca9f] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:15.526104 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-83a83ca1-ea60-4298-90b9-11794e83a51e tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:15.526595 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-08f4793c-070f-4d72-b41e-7b7d5f196659 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:15.526891 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-83a83ca1-ea60-4298-90b9-11794e83a51e tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:15.527078 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-08f4793c-070f-4d72-b41e-7b7d5f196659 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:15.527880 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-08f4793c-070f-4d72-b41e-7b7d5f196659 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:15.528285 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-83a83ca1-ea60-4298-90b9-11794e83a51e tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:15.528532 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-08f4793c-070f-4d72-b41e-7b7d5f196659 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:15.528997 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-83a83ca1-ea60-4298-90b9-11794e83a51e tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:15.715326 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-08f4793c-070f-4d72-b41e-7b7d5f196659 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14f6f890deb74eadab6b1ff4b6431036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e991e35dc5b463fbf9f08db0e72cf46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:15.728415 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-08f4793c-070f-4d72-b41e-7b7d5f196659 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] 10.222.0.79 "GET /compute/v2.1/servers/086c6296-168f-46fc-9ec4-8700b7c6ca9f" status: 200 len: 1358 microversion: 2.1 time: 0.214068 Jan 28 02:09:15.728961 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 278/550] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:09:15 2022] GET /compute/v2.1/servers/086c6296-168f-46fc-9ec4-8700b7c6ca9f => generated 1358 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:09:15.734177 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-eae7320e-5f9b-4d1b-ad73-47d8cf61dece tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:15.734840 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-eae7320e-5f9b-4d1b-ad73-47d8cf61dece tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] [instance: ec5e47ac-761b-467f-958c-516a9f8bc3e6] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:15.735320 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-83a83ca1-ea60-4298-90b9-11794e83a51e tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:15.741752 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-eae7320e-5f9b-4d1b-ad73-47d8cf61dece tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:15.742204 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-eae7320e-5f9b-4d1b-ad73-47d8cf61dece tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:15.742987 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-eae7320e-5f9b-4d1b-ad73-47d8cf61dece tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:15.743449 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-eae7320e-5f9b-4d1b-ad73-47d8cf61dece tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:15.745631 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-83a83ca1-ea60-4298-90b9-11794e83a51e tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:15.747354 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-83a83ca1-ea60-4298-90b9-11794e83a51e tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:15.748946 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-83a83ca1-ea60-4298-90b9-11794e83a51e tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84" status: 200 len: 1752 microversion: 2.20 time: 0.245631 Jan 28 02:09:15.750354 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 273/551] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:09:15 2022] GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84 => generated 1752 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:09:15.773556 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-c3d72fb5-b287-474a-8406-ca0f4ed3722e tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:15.774973 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-c3d72fb5-b287-474a-8406-ca0f4ed3722e tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] [instance: 96b38440-c5bd-4838-bd1b-46312012607e] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:15.786351 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c3d72fb5-b287-474a-8406-ca0f4ed3722e tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:15.786854 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c3d72fb5-b287-474a-8406-ca0f4ed3722e tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:15.787626 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c3d72fb5-b287-474a-8406-ca0f4ed3722e tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:15.788081 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c3d72fb5-b287-474a-8406-ca0f4ed3722e tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:15.944710 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-eae7320e-5f9b-4d1b-ad73-47d8cf61dece tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd7039b8f074a13b2030a2bb7aaff94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc19a0f9c33f47f1b504bebbb0b2c931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:15.952889 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-eae7320e-5f9b-4d1b-ad73-47d8cf61dece tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] 10.222.0.79 "GET /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6" status: 200 len: 1561 microversion: 2.1 time: 0.222691 Jan 28 02:09:15.953620 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 279/552] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:09:15 2022] GET /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6 => generated 1561 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:09:15.964683 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-c3d72fb5-b287-474a-8406-ca0f4ed3722e tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b019715a14074e059730965913694e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b66ddee4c864aae90b738695dffbeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:15.973056 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-c3d72fb5-b287-474a-8406-ca0f4ed3722e tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] 10.222.0.79 "GET /compute/v2.1/servers/96b38440-c5bd-4838-bd1b-46312012607e" status: 200 len: 1318 microversion: 2.1 time: 0.207992 Jan 28 02:09:15.973638 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 274/553] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:09:15 2022] GET /compute/v2.1/servers/96b38440-c5bd-4838-bd1b-46312012607e => generated 1318 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:09:16.026976 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-7b6e6c35-49db-430c-b33f-3901bbbf1b91 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:16.027463 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-7b6e6c35-49db-430c-b33f-3901bbbf1b91 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] [instance: ec5e47ac-761b-467f-958c-516a9f8bc3e6] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:16.036872 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-7b6e6c35-49db-430c-b33f-3901bbbf1b91 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:16.037489 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-7b6e6c35-49db-430c-b33f-3901bbbf1b91 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:16.038163 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-7b6e6c35-49db-430c-b33f-3901bbbf1b91 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:16.038604 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-7b6e6c35-49db-430c-b33f-3901bbbf1b91 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:16.132106 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.objects.instance [None req-7b6e6c35-49db-430c-b33f-3901bbbf1b91 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lazy-loading 'services' on Instance uuid ec5e47ac-761b-467f-958c-516a9f8bc3e6 {{(pid=116374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jan 28 02:09:16.401790 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-7b6e6c35-49db-430c-b33f-3901bbbf1b91 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] 10.222.0.79 "DELETE /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6/os-volume_attachments/86479932-7d1f-45f3-9fec-b01e2a4a4f70" status: 202 len: 0 microversion: 2.1 time: 0.375100 Jan 28 02:09:16.401790 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 280/554] 10.222.0.79 () {58 vars in 1415 bytes} [Fri Jan 28 02:09:16 2022] DELETE /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6/os-volume_attachments/86479932-7d1f-45f3-9fec-b01e2a4a4f70 => generated 0 bytes in 377 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:09:16.409615 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-eea4b41d-5717-4b97-a621-e5707040e83b tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:16.410760 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-eea4b41d-5717-4b97-a621-e5707040e83b tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] [instance: ec5e47ac-761b-467f-958c-516a9f8bc3e6] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:16.417728 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-eea4b41d-5717-4b97-a621-e5707040e83b tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:16.418173 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-eea4b41d-5717-4b97-a621-e5707040e83b tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:16.418948 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-eea4b41d-5717-4b97-a621-e5707040e83b tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:16.419472 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-eea4b41d-5717-4b97-a621-e5707040e83b tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:16.450285 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-eea4b41d-5717-4b97-a621-e5707040e83b tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] 10.222.0.79 "GET /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045276 Jan 28 02:09:16.450871 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 275/555] 10.222.0.79 () {58 vars in 1301 bytes} [Fri Jan 28 02:09:16 2022] GET /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:09:16.747607 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-5ee8652c-794c-47cb-9ad4-8ca1335daa07 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:16.748328 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-5ee8652c-794c-47cb-9ad4-8ca1335daa07 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] [instance: 086c6296-168f-46fc-9ec4-8700b7c6ca9f] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:16.754817 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-5ee8652c-794c-47cb-9ad4-8ca1335daa07 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:16.755271 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-5ee8652c-794c-47cb-9ad4-8ca1335daa07 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:16.756106 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-5ee8652c-794c-47cb-9ad4-8ca1335daa07 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:16.756596 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-5ee8652c-794c-47cb-9ad4-8ca1335daa07 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:16.768729 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-7f0e0beb-00ee-48f0-8e8f-bca753605126 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:16.769485 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-7f0e0beb-00ee-48f0-8e8f-bca753605126 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:16.775965 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-7f0e0beb-00ee-48f0-8e8f-bca753605126 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:16.776444 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-7f0e0beb-00ee-48f0-8e8f-bca753605126 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:16.777209 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-7f0e0beb-00ee-48f0-8e8f-bca753605126 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:16.777639 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-7f0e0beb-00ee-48f0-8e8f-bca753605126 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:16.983685 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-5ee8652c-794c-47cb-9ad4-8ca1335daa07 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14f6f890deb74eadab6b1ff4b6431036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e991e35dc5b463fbf9f08db0e72cf46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:16.991458 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-5ee8652c-794c-47cb-9ad4-8ca1335daa07 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] 10.222.0.79 "GET /compute/v2.1/servers/086c6296-168f-46fc-9ec4-8700b7c6ca9f" status: 200 len: 1358 microversion: 2.1 time: 0.247816 Jan 28 02:09:16.992050 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 281/556] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:09:16 2022] GET /compute/v2.1/servers/086c6296-168f-46fc-9ec4-8700b7c6ca9f => generated 1358 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:09:16.996685 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-7f0e0beb-00ee-48f0-8e8f-bca753605126 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:17.000597 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-fcffdeb3-a952-4e33-96ba-a98aa02a66f1 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:17.001205 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-fcffdeb3-a952-4e33-96ba-a98aa02a66f1 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] [instance: 96b38440-c5bd-4838-bd1b-46312012607e] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:17.007451 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-fcffdeb3-a952-4e33-96ba-a98aa02a66f1 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:17.007896 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-fcffdeb3-a952-4e33-96ba-a98aa02a66f1 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:17.008701 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-fcffdeb3-a952-4e33-96ba-a98aa02a66f1 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:17.009011 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-7f0e0beb-00ee-48f0-8e8f-bca753605126 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:17.009139 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-fcffdeb3-a952-4e33-96ba-a98aa02a66f1 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:17.010509 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-7f0e0beb-00ee-48f0-8e8f-bca753605126 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:17.011676 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-7f0e0beb-00ee-48f0-8e8f-bca753605126 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84" status: 200 len: 1808 microversion: 2.20 time: 0.247535 Jan 28 02:09:17.012343 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 276/557] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:09:16 2022] GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84 => generated 1808 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 02:09:17.275857 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-fcffdeb3-a952-4e33-96ba-a98aa02a66f1 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b019715a14074e059730965913694e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b66ddee4c864aae90b738695dffbeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:17.289039 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-fcffdeb3-a952-4e33-96ba-a98aa02a66f1 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] 10.222.0.79 "GET /compute/v2.1/servers/96b38440-c5bd-4838-bd1b-46312012607e" status: 200 len: 1509 microversion: 2.1 time: 0.295899 Jan 28 02:09:17.289608 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 282/558] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:09:16 2022] GET /compute/v2.1/servers/96b38440-c5bd-4838-bd1b-46312012607e => generated 1509 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:09:17.465294 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-3c21f415-a167-4997-aa80-f3b6c783dae6 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:17.466342 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-3c21f415-a167-4997-aa80-f3b6c783dae6 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] [instance: ec5e47ac-761b-467f-958c-516a9f8bc3e6] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:17.473419 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-3c21f415-a167-4997-aa80-f3b6c783dae6 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:17.474106 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-3c21f415-a167-4997-aa80-f3b6c783dae6 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:17.475062 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-3c21f415-a167-4997-aa80-f3b6c783dae6 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:17.475486 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-3c21f415-a167-4997-aa80-f3b6c783dae6 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:17.522297 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-3c21f415-a167-4997-aa80-f3b6c783dae6 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] 10.222.0.79 "GET /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063745 Jan 28 02:09:17.522876 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 277/559] 10.222.0.79 () {58 vars in 1301 bytes} [Fri Jan 28 02:09:17 2022] GET /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:09:18.010121 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-94f717f3-43e4-4327-b9aa-3f51d71d956a tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:18.010810 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-94f717f3-43e4-4327-b9aa-3f51d71d956a tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] [instance: 086c6296-168f-46fc-9ec4-8700b7c6ca9f] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:18.017298 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-94f717f3-43e4-4327-b9aa-3f51d71d956a tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:18.020504 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-94f717f3-43e4-4327-b9aa-3f51d71d956a tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:18.020504 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-94f717f3-43e4-4327-b9aa-3f51d71d956a tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:18.020504 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-94f717f3-43e4-4327-b9aa-3f51d71d956a tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:18.031205 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-8f775937-67b4-43f6-a2dc-7d86d0b7e944 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:18.031964 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-8f775937-67b4-43f6-a2dc-7d86d0b7e944 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:18.037805 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-8f775937-67b4-43f6-a2dc-7d86d0b7e944 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:18.038331 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-8f775937-67b4-43f6-a2dc-7d86d0b7e944 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:18.039538 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-8f775937-67b4-43f6-a2dc-7d86d0b7e944 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:18.040136 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-8f775937-67b4-43f6-a2dc-7d86d0b7e944 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:18.288192 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-94f717f3-43e4-4327-b9aa-3f51d71d956a tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14f6f890deb74eadab6b1ff4b6431036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e991e35dc5b463fbf9f08db0e72cf46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:18.298401 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-94f717f3-43e4-4327-b9aa-3f51d71d956a tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] 10.222.0.79 "GET /compute/v2.1/servers/086c6296-168f-46fc-9ec4-8700b7c6ca9f" status: 200 len: 1358 microversion: 2.1 time: 0.292021 Jan 28 02:09:18.308047 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-8f775937-67b4-43f6-a2dc-7d86d0b7e944 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:18.309139 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 283/560] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:09:18 2022] GET /compute/v2.1/servers/086c6296-168f-46fc-9ec4-8700b7c6ca9f => generated 1358 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:09:18.313138 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-8f775937-67b4-43f6-a2dc-7d86d0b7e944 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:18.314696 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-8f775937-67b4-43f6-a2dc-7d86d0b7e944 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:18.315991 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-8f775937-67b4-43f6-a2dc-7d86d0b7e944 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84" status: 200 len: 1808 microversion: 2.20 time: 0.289114 Jan 28 02:09:18.316767 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 278/561] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:09:18 2022] GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84 => generated 1808 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:09:18.545409 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-fa95fb1c-9fd9-4b48-8d59-6b9907e4a615 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:18.547352 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-fa95fb1c-9fd9-4b48-8d59-6b9907e4a615 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] [instance: ec5e47ac-761b-467f-958c-516a9f8bc3e6] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:18.553340 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-fa95fb1c-9fd9-4b48-8d59-6b9907e4a615 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:18.553798 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-fa95fb1c-9fd9-4b48-8d59-6b9907e4a615 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:18.554545 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-fa95fb1c-9fd9-4b48-8d59-6b9907e4a615 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:18.554971 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-fa95fb1c-9fd9-4b48-8d59-6b9907e4a615 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:18.591653 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-fa95fb1c-9fd9-4b48-8d59-6b9907e4a615 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] 10.222.0.79 "GET /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055917 Jan 28 02:09:18.596271 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 284/562] 10.222.0.79 () {58 vars in 1301 bytes} [Fri Jan 28 02:09:18 2022] GET /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:09:18.957769 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-60dfcda7-537f-4b4d-95c4-45679fefd835 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e0359e21-83f0-45b8-8432-3145b1cee372"}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:09:18.958899 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-60dfcda7-537f-4b4d-95c4-45679fefd835 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] [instance: 96b38440-c5bd-4838-bd1b-46312012607e] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:18.965130 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-60dfcda7-537f-4b4d-95c4-45679fefd835 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:18.965638 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-60dfcda7-537f-4b4d-95c4-45679fefd835 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:18.966626 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-60dfcda7-537f-4b4d-95c4-45679fefd835 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:18.967481 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-60dfcda7-537f-4b4d-95c4-45679fefd835 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:19.315470 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-482b0fc3-2fad-41e5-a7dc-3617a81e30b0 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:19.316918 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-482b0fc3-2fad-41e5-a7dc-3617a81e30b0 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] [instance: 086c6296-168f-46fc-9ec4-8700b7c6ca9f] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:19.326525 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-482b0fc3-2fad-41e5-a7dc-3617a81e30b0 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:19.328792 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-482b0fc3-2fad-41e5-a7dc-3617a81e30b0 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:19.333186 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-482b0fc3-2fad-41e5-a7dc-3617a81e30b0 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:19.333186 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-482b0fc3-2fad-41e5-a7dc-3617a81e30b0 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:19.650020 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-482b0fc3-2fad-41e5-a7dc-3617a81e30b0 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14f6f890deb74eadab6b1ff4b6431036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e991e35dc5b463fbf9f08db0e72cf46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:19.673554 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-482b0fc3-2fad-41e5-a7dc-3617a81e30b0 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] 10.222.0.79 "GET /compute/v2.1/servers/086c6296-168f-46fc-9ec4-8700b7c6ca9f" status: 200 len: 1358 microversion: 2.1 time: 0.362434 Jan 28 02:09:19.674595 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 285/563] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:09:19 2022] GET /compute/v2.1/servers/086c6296-168f-46fc-9ec4-8700b7c6ca9f => generated 1358 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:09:19.700868 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-5443c6e9-a138-4723-b9cd-305a646a374f tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:19.715702 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-5443c6e9-a138-4723-b9cd-305a646a374f tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:19.732818 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-5443c6e9-a138-4723-b9cd-305a646a374f tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:19.734048 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-5443c6e9-a138-4723-b9cd-305a646a374f tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:19.735333 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-5443c6e9-a138-4723-b9cd-305a646a374f tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:19.742659 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-5443c6e9-a138-4723-b9cd-305a646a374f tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:19.985085 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-5443c6e9-a138-4723-b9cd-305a646a374f tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:19.996627 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-5443c6e9-a138-4723-b9cd-305a646a374f tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:19.998598 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-5443c6e9-a138-4723-b9cd-305a646a374f tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:20.000979 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-5443c6e9-a138-4723-b9cd-305a646a374f tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84" status: 200 len: 1808 microversion: 2.20 time: 0.324947 Jan 28 02:09:20.002148 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 286/564] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:09:19 2022] GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84 => generated 1808 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:09:20.017117 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-109a436c-8c5b-44f3-914f-8373766b24b9 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:20.018442 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-109a436c-8c5b-44f3-914f-8373766b24b9 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] [instance: ec5e47ac-761b-467f-958c-516a9f8bc3e6] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:20.033666 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-109a436c-8c5b-44f3-914f-8373766b24b9 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:20.034390 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-109a436c-8c5b-44f3-914f-8373766b24b9 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:20.035330 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-109a436c-8c5b-44f3-914f-8373766b24b9 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:20.035918 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-109a436c-8c5b-44f3-914f-8373766b24b9 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:20.112667 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-109a436c-8c5b-44f3-914f-8373766b24b9 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] 10.222.0.79 "GET /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.109090 Jan 28 02:09:20.113247 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 287/565] 10.222.0.79 () {58 vars in 1301 bytes} [Fri Jan 28 02:09:20 2022] GET /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6/os-volume_attachments => generated 197 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:09:20.699461 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-845c1208-5c32-42b8-9629-d080636bdc05 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:20.701963 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-845c1208-5c32-42b8-9629-d080636bdc05 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] [instance: 086c6296-168f-46fc-9ec4-8700b7c6ca9f] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:20.710481 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-845c1208-5c32-42b8-9629-d080636bdc05 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:20.710924 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-845c1208-5c32-42b8-9629-d080636bdc05 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:20.711703 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-845c1208-5c32-42b8-9629-d080636bdc05 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:20.712264 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-845c1208-5c32-42b8-9629-d080636bdc05 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:20.886058 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-845c1208-5c32-42b8-9629-d080636bdc05 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14f6f890deb74eadab6b1ff4b6431036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e991e35dc5b463fbf9f08db0e72cf46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:20.894973 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-845c1208-5c32-42b8-9629-d080636bdc05 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] 10.222.0.79 "GET /compute/v2.1/servers/086c6296-168f-46fc-9ec4-8700b7c6ca9f" status: 200 len: 1358 microversion: 2.1 time: 0.207290 Jan 28 02:09:20.904557 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 288/566] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:09:20 2022] GET /compute/v2.1/servers/086c6296-168f-46fc-9ec4-8700b7c6ca9f => generated 1358 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:09:21.028812 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-2bdda27f-f619-4e9e-ba9c-e63a77ebc090 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:21.029430 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-2bdda27f-f619-4e9e-ba9c-e63a77ebc090 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:21.054494 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-2bdda27f-f619-4e9e-ba9c-e63a77ebc090 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:21.055599 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-2bdda27f-f619-4e9e-ba9c-e63a77ebc090 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:21.061215 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-2bdda27f-f619-4e9e-ba9c-e63a77ebc090 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:21.061215 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-2bdda27f-f619-4e9e-ba9c-e63a77ebc090 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:21.287945 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-2bdda27f-f619-4e9e-ba9c-e63a77ebc090 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:21.304563 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-2bdda27f-f619-4e9e-ba9c-e63a77ebc090 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:21.306597 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-2bdda27f-f619-4e9e-ba9c-e63a77ebc090 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:21.309340 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-2bdda27f-f619-4e9e-ba9c-e63a77ebc090 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84" status: 200 len: 1808 microversion: 2.20 time: 0.287678 Jan 28 02:09:21.316244 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 289/567] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:09:21 2022] GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84 => generated 1808 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:09:21.321327 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-ec413493-6939-4b79-ae1b-b77fccc7837e tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:21.334020 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-ec413493-6939-4b79-ae1b-b77fccc7837e tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] [instance: ec5e47ac-761b-467f-958c-516a9f8bc3e6] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:21.347028 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-ec413493-6939-4b79-ae1b-b77fccc7837e tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:21.356594 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-ec413493-6939-4b79-ae1b-b77fccc7837e tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:21.357832 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-ec413493-6939-4b79-ae1b-b77fccc7837e tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:21.359039 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-ec413493-6939-4b79-ae1b-b77fccc7837e tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:21.412891 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-ec413493-6939-4b79-ae1b-b77fccc7837e tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] 10.222.0.79 "GET /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.095079 Jan 28 02:09:21.414223 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 290/568] 10.222.0.79 () {58 vars in 1301 bytes} [Fri Jan 28 02:09:21 2022] GET /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6/os-volume_attachments => generated 197 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:09:21.912289 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-72bc1857-0564-4f15-b6fd-bbb1048868db tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:21.913101 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-72bc1857-0564-4f15-b6fd-bbb1048868db tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] [instance: 086c6296-168f-46fc-9ec4-8700b7c6ca9f] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:21.918964 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-72bc1857-0564-4f15-b6fd-bbb1048868db tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:21.919485 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-72bc1857-0564-4f15-b6fd-bbb1048868db tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:21.920355 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-72bc1857-0564-4f15-b6fd-bbb1048868db tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:21.921063 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-72bc1857-0564-4f15-b6fd-bbb1048868db tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:22.215038 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-72bc1857-0564-4f15-b6fd-bbb1048868db tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14f6f890deb74eadab6b1ff4b6431036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e991e35dc5b463fbf9f08db0e72cf46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:22.223888 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-72bc1857-0564-4f15-b6fd-bbb1048868db tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] 10.222.0.79 "GET /compute/v2.1/servers/086c6296-168f-46fc-9ec4-8700b7c6ca9f" status: 200 len: 1358 microversion: 2.1 time: 0.315234 Jan 28 02:09:22.225132 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 291/569] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:09:21 2022] GET /compute/v2.1/servers/086c6296-168f-46fc-9ec4-8700b7c6ca9f => generated 1358 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:09:22.339492 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-a4b9cd01-bfc8-4ed0-ac00-30b393bd7a14 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:22.344575 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-a4b9cd01-bfc8-4ed0-ac00-30b393bd7a14 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:22.352517 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-a4b9cd01-bfc8-4ed0-ac00-30b393bd7a14 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:22.353181 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-a4b9cd01-bfc8-4ed0-ac00-30b393bd7a14 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:22.354071 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-a4b9cd01-bfc8-4ed0-ac00-30b393bd7a14 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:22.354646 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-a4b9cd01-bfc8-4ed0-ac00-30b393bd7a14 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:22.626992 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-a4b9cd01-bfc8-4ed0-ac00-30b393bd7a14 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:22.638849 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-a4b9cd01-bfc8-4ed0-ac00-30b393bd7a14 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:22.638849 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-a4b9cd01-bfc8-4ed0-ac00-30b393bd7a14 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:22.655565 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-a4b9cd01-bfc8-4ed0-ac00-30b393bd7a14 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84" status: 200 len: 1808 microversion: 2.20 time: 0.306967 Jan 28 02:09:22.656309 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 292/570] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:09:22 2022] GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84 => generated 1808 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:09:22.662121 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-30959cac-5839-4114-8979-0d3ebbdbf10a tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:22.663033 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-30959cac-5839-4114-8979-0d3ebbdbf10a tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] [instance: ec5e47ac-761b-467f-958c-516a9f8bc3e6] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:22.676994 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-30959cac-5839-4114-8979-0d3ebbdbf10a tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:22.677441 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-30959cac-5839-4114-8979-0d3ebbdbf10a tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:22.678215 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-30959cac-5839-4114-8979-0d3ebbdbf10a tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:22.678645 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-30959cac-5839-4114-8979-0d3ebbdbf10a tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:22.714959 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-30959cac-5839-4114-8979-0d3ebbdbf10a tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] 10.222.0.79 "GET /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057278 Jan 28 02:09:22.715556 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 293/571] 10.222.0.79 () {58 vars in 1301 bytes} [Fri Jan 28 02:09:22 2022] GET /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:09:23.241128 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-a287352b-857d-45d9-a0c8-d1ece0101dd1 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:23.241657 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-a287352b-857d-45d9-a0c8-d1ece0101dd1 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] [instance: 086c6296-168f-46fc-9ec4-8700b7c6ca9f] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:23.247732 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-a287352b-857d-45d9-a0c8-d1ece0101dd1 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:23.248461 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-a287352b-857d-45d9-a0c8-d1ece0101dd1 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:23.249748 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-a287352b-857d-45d9-a0c8-d1ece0101dd1 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:23.250226 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-a287352b-857d-45d9-a0c8-d1ece0101dd1 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:23.495271 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-a287352b-857d-45d9-a0c8-d1ece0101dd1 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14f6f890deb74eadab6b1ff4b6431036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e991e35dc5b463fbf9f08db0e72cf46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:23.505872 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-a287352b-857d-45d9-a0c8-d1ece0101dd1 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] 10.222.0.79 "GET /compute/v2.1/servers/086c6296-168f-46fc-9ec4-8700b7c6ca9f" status: 200 len: 1358 microversion: 2.1 time: 0.268670 Jan 28 02:09:23.517172 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 294/572] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:09:23 2022] GET /compute/v2.1/servers/086c6296-168f-46fc-9ec4-8700b7c6ca9f => generated 1358 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:09:23.676048 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-d8210860-83c8-43eb-abfb-784b7d5b6e86 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:23.676667 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-d8210860-83c8-43eb-abfb-784b7d5b6e86 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:23.683482 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-d8210860-83c8-43eb-abfb-784b7d5b6e86 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:23.723490 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-d8210860-83c8-43eb-abfb-784b7d5b6e86 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.040s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:23.724846 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-d8210860-83c8-43eb-abfb-784b7d5b6e86 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:23.725596 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-d8210860-83c8-43eb-abfb-784b7d5b6e86 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:23.976917 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-d8210860-83c8-43eb-abfb-784b7d5b6e86 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:23.986453 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-d8210860-83c8-43eb-abfb-784b7d5b6e86 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:23.989388 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-d8210860-83c8-43eb-abfb-784b7d5b6e86 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:23.995764 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-d8210860-83c8-43eb-abfb-784b7d5b6e86 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84" status: 200 len: 1808 microversion: 2.20 time: 0.320129 Jan 28 02:09:23.995764 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 295/573] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:09:23 2022] GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84 => generated 1808 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 02:09:23.997982 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-309ef816-d958-4413-802a-c9f0378e44dc tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:23.998955 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-309ef816-d958-4413-802a-c9f0378e44dc tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] [instance: ec5e47ac-761b-467f-958c-516a9f8bc3e6] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:24.005253 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-309ef816-d958-4413-802a-c9f0378e44dc tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:24.005693 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-309ef816-d958-4413-802a-c9f0378e44dc tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:24.006546 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-309ef816-d958-4413-802a-c9f0378e44dc tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:24.006952 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-309ef816-d958-4413-802a-c9f0378e44dc tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:24.044860 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-309ef816-d958-4413-802a-c9f0378e44dc tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] 10.222.0.79 "GET /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050830 Jan 28 02:09:24.046223 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 296/574] 10.222.0.79 () {58 vars in 1301 bytes} [Fri Jan 28 02:09:23 2022] GET /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:09:24.524953 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-8ea0bada-b388-4f6a-9773-585b9c953682 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:24.525690 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-8ea0bada-b388-4f6a-9773-585b9c953682 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] [instance: 086c6296-168f-46fc-9ec4-8700b7c6ca9f] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:24.542399 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-8ea0bada-b388-4f6a-9773-585b9c953682 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:24.550841 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-8ea0bada-b388-4f6a-9773-585b9c953682 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:24.553141 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-8ea0bada-b388-4f6a-9773-585b9c953682 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:24.553669 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-8ea0bada-b388-4f6a-9773-585b9c953682 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:24.796737 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-8ea0bada-b388-4f6a-9773-585b9c953682 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14f6f890deb74eadab6b1ff4b6431036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e991e35dc5b463fbf9f08db0e72cf46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:24.806974 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-8ea0bada-b388-4f6a-9773-585b9c953682 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] 10.222.0.79 "GET /compute/v2.1/servers/086c6296-168f-46fc-9ec4-8700b7c6ca9f" status: 200 len: 1358 microversion: 2.1 time: 0.285892 Jan 28 02:09:24.816476 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 297/575] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:09:24 2022] GET /compute/v2.1/servers/086c6296-168f-46fc-9ec4-8700b7c6ca9f => generated 1358 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:09:24.816476 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [req-03ba98c1-eaf5-49ba-ab17-505c39306a42 req-1ae98549-b4a8-4293-b082-8e663306d542 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "086c6296-168f-46fc-9ec4-8700b7c6ca9f", "name": "network-vif-plugged", "status": "completed", "tag": "deb20626-b237-4650-a93b-12a633f6daa5"}]} {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:09:24.816772 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:09:24.816772 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: warnings.warn(msg) Jan 28 02:09:24.826855 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [req-03ba98c1-eaf5-49ba-ab17-505c39306a42 req-1ae98549-b4a8-4293-b082-8e663306d542 service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:24.832844 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [req-03ba98c1-eaf5-49ba-ab17-505c39306a42 req-1ae98549-b4a8-4293-b082-8e663306d542 service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:24.858172 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.compute.server_external_events [req-03ba98c1-eaf5-49ba-ab17-505c39306a42 req-1ae98549-b4a8-4293-b082-8e663306d542 service nova] Creating event network-vif-plugged:deb20626-b237-4650-a93b-12a633f6daa5 for instance 086c6296-168f-46fc-9ec4-8700b7c6ca9f on hv-cinder-82497 Jan 28 02:09:24.864270 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [req-03ba98c1-eaf5-49ba-ab17-505c39306a42 req-1ae98549-b4a8-4293-b082-8e663306d542 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054577 Jan 28 02:09:24.867421 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 298/576] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Jan 28 02:09:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:09:25.018591 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-eaabbcdc-b98f-43c8-a5ff-5d7461498b18 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:25.019320 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-eaabbcdc-b98f-43c8-a5ff-5d7461498b18 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:25.026237 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-eaabbcdc-b98f-43c8-a5ff-5d7461498b18 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:25.026687 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-eaabbcdc-b98f-43c8-a5ff-5d7461498b18 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:25.027475 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-eaabbcdc-b98f-43c8-a5ff-5d7461498b18 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:25.027907 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-eaabbcdc-b98f-43c8-a5ff-5d7461498b18 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:25.267422 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-eaabbcdc-b98f-43c8-a5ff-5d7461498b18 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:25.281579 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-eaabbcdc-b98f-43c8-a5ff-5d7461498b18 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:25.283612 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-eaabbcdc-b98f-43c8-a5ff-5d7461498b18 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:25.284927 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-eaabbcdc-b98f-43c8-a5ff-5d7461498b18 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84" status: 200 len: 1808 microversion: 2.20 time: 0.273225 Jan 28 02:09:25.290537 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 299/577] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:09:25 2022] GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84 => generated 1808 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:09:25.290537 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-e848af92-61b7-4388-9554-13459f27a0aa tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:25.291712 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-e848af92-61b7-4388-9554-13459f27a0aa tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] [instance: ec5e47ac-761b-467f-958c-516a9f8bc3e6] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:25.304956 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-e848af92-61b7-4388-9554-13459f27a0aa tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:25.305682 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-e848af92-61b7-4388-9554-13459f27a0aa tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:25.306690 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-e848af92-61b7-4388-9554-13459f27a0aa tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:25.307391 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-e848af92-61b7-4388-9554-13459f27a0aa tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:25.342346 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-e848af92-61b7-4388-9554-13459f27a0aa tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] 10.222.0.79 "GET /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055808 Jan 28 02:09:25.350786 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 300/578] 10.222.0.79 () {58 vars in 1301 bytes} [Fri Jan 28 02:09:25 2022] GET /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:09:25.825525 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-a2027704-047f-4a70-98e4-73cf38e2f97e tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:25.826291 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-a2027704-047f-4a70-98e4-73cf38e2f97e tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] [instance: 086c6296-168f-46fc-9ec4-8700b7c6ca9f] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:25.844150 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-a2027704-047f-4a70-98e4-73cf38e2f97e tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:25.853659 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-a2027704-047f-4a70-98e4-73cf38e2f97e tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:25.854891 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-a2027704-047f-4a70-98e4-73cf38e2f97e tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:25.855327 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-a2027704-047f-4a70-98e4-73cf38e2f97e tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:26.103550 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-a2027704-047f-4a70-98e4-73cf38e2f97e tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14f6f890deb74eadab6b1ff4b6431036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e991e35dc5b463fbf9f08db0e72cf46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:26.113552 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-a2027704-047f-4a70-98e4-73cf38e2f97e tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] 10.222.0.79 "GET /compute/v2.1/servers/086c6296-168f-46fc-9ec4-8700b7c6ca9f" status: 200 len: 1358 microversion: 2.1 time: 0.291903 Jan 28 02:09:26.114689 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 301/579] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:09:25 2022] GET /compute/v2.1/servers/086c6296-168f-46fc-9ec4-8700b7c6ca9f => generated 1358 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:09:26.308664 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-bf158630-c41d-45c3-ba76-8ed834356735 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:26.309711 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-bf158630-c41d-45c3-ba76-8ed834356735 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:26.316084 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-bf158630-c41d-45c3-ba76-8ed834356735 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:26.316620 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-bf158630-c41d-45c3-ba76-8ed834356735 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:26.317495 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-bf158630-c41d-45c3-ba76-8ed834356735 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:26.318116 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-bf158630-c41d-45c3-ba76-8ed834356735 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:26.482652 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-bf158630-c41d-45c3-ba76-8ed834356735 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:26.490884 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-bf158630-c41d-45c3-ba76-8ed834356735 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:26.492639 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-bf158630-c41d-45c3-ba76-8ed834356735 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:26.493882 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-bf158630-c41d-45c3-ba76-8ed834356735 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84" status: 200 len: 1808 microversion: 2.20 time: 0.190777 Jan 28 02:09:26.506442 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 302/580] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:09:26 2022] GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84 => generated 1808 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:09:26.512100 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-e0ade994-cf09-4524-b30f-cf3783970452 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:26.513139 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-e0ade994-cf09-4524-b30f-cf3783970452 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] [instance: ec5e47ac-761b-467f-958c-516a9f8bc3e6] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:26.520497 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-e0ade994-cf09-4524-b30f-cf3783970452 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:26.521046 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-e0ade994-cf09-4524-b30f-cf3783970452 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:26.521889 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-e0ade994-cf09-4524-b30f-cf3783970452 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:26.522443 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-e0ade994-cf09-4524-b30f-cf3783970452 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:26.564166 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-e0ade994-cf09-4524-b30f-cf3783970452 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] 10.222.0.79 "GET /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056139 Jan 28 02:09:26.568885 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 303/581] 10.222.0.79 () {58 vars in 1301 bytes} [Fri Jan 28 02:09:26 2022] GET /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:09:27.154886 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-b38d431b-60cf-4bb1-ba7e-b1b92a68696f tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:27.154886 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-b38d431b-60cf-4bb1-ba7e-b1b92a68696f tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] [instance: 086c6296-168f-46fc-9ec4-8700b7c6ca9f] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:27.169615 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-b38d431b-60cf-4bb1-ba7e-b1b92a68696f tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:27.176827 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-b38d431b-60cf-4bb1-ba7e-b1b92a68696f tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:27.177882 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-b38d431b-60cf-4bb1-ba7e-b1b92a68696f tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:27.178104 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-b38d431b-60cf-4bb1-ba7e-b1b92a68696f tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:27.412897 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-b38d431b-60cf-4bb1-ba7e-b1b92a68696f tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14f6f890deb74eadab6b1ff4b6431036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e991e35dc5b463fbf9f08db0e72cf46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:27.423108 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-b38d431b-60cf-4bb1-ba7e-b1b92a68696f tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] 10.222.0.79 "GET /compute/v2.1/servers/086c6296-168f-46fc-9ec4-8700b7c6ca9f" status: 200 len: 1358 microversion: 2.1 time: 0.294966 Jan 28 02:09:27.423709 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 304/582] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:09:27 2022] GET /compute/v2.1/servers/086c6296-168f-46fc-9ec4-8700b7c6ca9f => generated 1358 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:09:27.514990 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-565dc934-a69e-48ad-8eaf-1a72fa5a4f00 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:27.515633 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-565dc934-a69e-48ad-8eaf-1a72fa5a4f00 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:27.531711 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-565dc934-a69e-48ad-8eaf-1a72fa5a4f00 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:27.532322 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-565dc934-a69e-48ad-8eaf-1a72fa5a4f00 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:27.533199 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-565dc934-a69e-48ad-8eaf-1a72fa5a4f00 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:27.538037 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-565dc934-a69e-48ad-8eaf-1a72fa5a4f00 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:27.744979 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-565dc934-a69e-48ad-8eaf-1a72fa5a4f00 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:27.758649 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-565dc934-a69e-48ad-8eaf-1a72fa5a4f00 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:27.760255 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-565dc934-a69e-48ad-8eaf-1a72fa5a4f00 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:27.761618 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-565dc934-a69e-48ad-8eaf-1a72fa5a4f00 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84" status: 200 len: 1808 microversion: 2.20 time: 0.252128 Jan 28 02:09:27.762477 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 305/583] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:09:27 2022] GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84 => generated 1808 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 02:09:27.768335 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-6f0884c7-1d21-4c76-9a20-8c0b083663c9 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:27.769382 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-6f0884c7-1d21-4c76-9a20-8c0b083663c9 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] [instance: ec5e47ac-761b-467f-958c-516a9f8bc3e6] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:27.775587 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-6f0884c7-1d21-4c76-9a20-8c0b083663c9 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:27.776057 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-6f0884c7-1d21-4c76-9a20-8c0b083663c9 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:27.776854 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-6f0884c7-1d21-4c76-9a20-8c0b083663c9 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:27.777803 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-6f0884c7-1d21-4c76-9a20-8c0b083663c9 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:27.820585 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-6f0884c7-1d21-4c76-9a20-8c0b083663c9 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] 10.222.0.79 "GET /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056934 Jan 28 02:09:27.821199 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 306/584] 10.222.0.79 () {58 vars in 1301 bytes} [Fri Jan 28 02:09:27 2022] GET /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:09:28.441197 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-1869b5c6-28fc-4f60-adca-4a01508d6f76 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:28.444999 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-1869b5c6-28fc-4f60-adca-4a01508d6f76 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] [instance: 086c6296-168f-46fc-9ec4-8700b7c6ca9f] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:28.450269 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-1869b5c6-28fc-4f60-adca-4a01508d6f76 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:28.451007 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-1869b5c6-28fc-4f60-adca-4a01508d6f76 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:28.452811 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-1869b5c6-28fc-4f60-adca-4a01508d6f76 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:28.453685 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-1869b5c6-28fc-4f60-adca-4a01508d6f76 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:28.670103 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-1869b5c6-28fc-4f60-adca-4a01508d6f76 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14f6f890deb74eadab6b1ff4b6431036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e991e35dc5b463fbf9f08db0e72cf46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:28.681936 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-1869b5c6-28fc-4f60-adca-4a01508d6f76 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] 10.222.0.79 "GET /compute/v2.1/servers/086c6296-168f-46fc-9ec4-8700b7c6ca9f" status: 200 len: 1358 microversion: 2.1 time: 0.245492 Jan 28 02:09:28.682980 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 307/585] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:09:28 2022] GET /compute/v2.1/servers/086c6296-168f-46fc-9ec4-8700b7c6ca9f => generated 1358 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:09:28.782733 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-7032a73f-12a7-47b0-86fa-b8112abc7d16 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:28.783419 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-7032a73f-12a7-47b0-86fa-b8112abc7d16 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:28.792884 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-7032a73f-12a7-47b0-86fa-b8112abc7d16 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:28.793332 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-7032a73f-12a7-47b0-86fa-b8112abc7d16 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:28.794108 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-7032a73f-12a7-47b0-86fa-b8112abc7d16 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:28.800192 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-7032a73f-12a7-47b0-86fa-b8112abc7d16 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:28.974087 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-7032a73f-12a7-47b0-86fa-b8112abc7d16 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:28.987121 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-7032a73f-12a7-47b0-86fa-b8112abc7d16 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:28.988994 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-7032a73f-12a7-47b0-86fa-b8112abc7d16 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:28.990382 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-7032a73f-12a7-47b0-86fa-b8112abc7d16 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84" status: 200 len: 1808 microversion: 2.20 time: 0.213414 Jan 28 02:09:28.991830 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 308/586] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:09:28 2022] GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84 => generated 1808 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 02:09:29.002012 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-bc26bbd4-5f35-4fab-9d59-1421cc52c9b9 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:29.003653 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-bc26bbd4-5f35-4fab-9d59-1421cc52c9b9 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] [instance: ec5e47ac-761b-467f-958c-516a9f8bc3e6] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:29.026603 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-bc26bbd4-5f35-4fab-9d59-1421cc52c9b9 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:29.027491 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-bc26bbd4-5f35-4fab-9d59-1421cc52c9b9 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:29.028012 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-bc26bbd4-5f35-4fab-9d59-1421cc52c9b9 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:29.030889 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-bc26bbd4-5f35-4fab-9d59-1421cc52c9b9 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:29.164612 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-bc26bbd4-5f35-4fab-9d59-1421cc52c9b9 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] 10.222.0.79 "GET /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.157090 Jan 28 02:09:29.164612 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 309/587] 10.222.0.79 () {58 vars in 1301 bytes} [Fri Jan 28 02:09:28 2022] GET /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6/os-volume_attachments => generated 197 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:09:29.701388 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-59019467-1b41-432c-9413-994c9d76d900 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:29.704076 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-59019467-1b41-432c-9413-994c9d76d900 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] [instance: 086c6296-168f-46fc-9ec4-8700b7c6ca9f] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:29.728050 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-59019467-1b41-432c-9413-994c9d76d900 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:29.728050 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-59019467-1b41-432c-9413-994c9d76d900 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:29.728050 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-59019467-1b41-432c-9413-994c9d76d900 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:29.728050 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-59019467-1b41-432c-9413-994c9d76d900 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:29.896374 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-59019467-1b41-432c-9413-994c9d76d900 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14f6f890deb74eadab6b1ff4b6431036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e991e35dc5b463fbf9f08db0e72cf46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:29.905398 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-59019467-1b41-432c-9413-994c9d76d900 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] 10.222.0.79 "GET /compute/v2.1/servers/086c6296-168f-46fc-9ec4-8700b7c6ca9f" status: 200 len: 1358 microversion: 2.1 time: 0.208941 Jan 28 02:09:29.905978 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 310/588] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:09:29 2022] GET /compute/v2.1/servers/086c6296-168f-46fc-9ec4-8700b7c6ca9f => generated 1358 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:09:30.010823 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-dedcfed6-5684-4124-9c89-eed3983f3c24 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:30.011419 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-dedcfed6-5684-4124-9c89-eed3983f3c24 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:30.018582 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-dedcfed6-5684-4124-9c89-eed3983f3c24 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:30.019058 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-dedcfed6-5684-4124-9c89-eed3983f3c24 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:30.020118 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-dedcfed6-5684-4124-9c89-eed3983f3c24 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:30.020557 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-dedcfed6-5684-4124-9c89-eed3983f3c24 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:30.266171 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-dedcfed6-5684-4124-9c89-eed3983f3c24 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:30.280790 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-dedcfed6-5684-4124-9c89-eed3983f3c24 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:30.282400 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-dedcfed6-5684-4124-9c89-eed3983f3c24 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:30.283608 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-dedcfed6-5684-4124-9c89-eed3983f3c24 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84" status: 200 len: 1808 microversion: 2.20 time: 0.276652 Jan 28 02:09:30.284527 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 311/589] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:09:30 2022] GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84 => generated 1808 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:09:30.288920 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-5df39a99-d71d-4cf5-9cbe-a6f86f6a8d25 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:30.290234 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-5df39a99-d71d-4cf5-9cbe-a6f86f6a8d25 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] [instance: ec5e47ac-761b-467f-958c-516a9f8bc3e6] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:30.297066 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-5df39a99-d71d-4cf5-9cbe-a6f86f6a8d25 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:30.297507 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-5df39a99-d71d-4cf5-9cbe-a6f86f6a8d25 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:30.298276 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-5df39a99-d71d-4cf5-9cbe-a6f86f6a8d25 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:30.298738 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-5df39a99-d71d-4cf5-9cbe-a6f86f6a8d25 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:30.332212 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-5df39a99-d71d-4cf5-9cbe-a6f86f6a8d25 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] 10.222.0.79 "GET /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046584 Jan 28 02:09:30.333286 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 312/590] 10.222.0.79 () {58 vars in 1301 bytes} [Fri Jan 28 02:09:30 2022] GET /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:09:30.455351 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-60dfcda7-537f-4b4d-95c4-45679fefd835 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] 10.222.0.79 "POST /compute/v2.1/servers/96b38440-c5bd-4838-bd1b-46312012607e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 11.501331 Jan 28 02:09:30.460218 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 279/591] 10.222.0.79 () {60 vars in 1322 bytes} [Fri Jan 28 02:09:18 2022] POST /compute/v2.1/servers/96b38440-c5bd-4838-bd1b-46312012607e/os-volume_attachments => generated 194 bytes in 11503 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:09:30.922907 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-98f27fbf-e775-49b0-99fb-5b073a2fd546 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:30.923517 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-98f27fbf-e775-49b0-99fb-5b073a2fd546 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] [instance: 086c6296-168f-46fc-9ec4-8700b7c6ca9f] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:30.929937 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-98f27fbf-e775-49b0-99fb-5b073a2fd546 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:30.930387 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-98f27fbf-e775-49b0-99fb-5b073a2fd546 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:30.931167 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-98f27fbf-e775-49b0-99fb-5b073a2fd546 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:30.931595 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-98f27fbf-e775-49b0-99fb-5b073a2fd546 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:31.112887 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-98f27fbf-e775-49b0-99fb-5b073a2fd546 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14f6f890deb74eadab6b1ff4b6431036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e991e35dc5b463fbf9f08db0e72cf46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:31.137445 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-98f27fbf-e775-49b0-99fb-5b073a2fd546 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] 10.222.0.79 "GET /compute/v2.1/servers/086c6296-168f-46fc-9ec4-8700b7c6ca9f" status: 200 len: 1358 microversion: 2.1 time: 0.218942 Jan 28 02:09:31.143799 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 313/592] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:09:30 2022] GET /compute/v2.1/servers/086c6296-168f-46fc-9ec4-8700b7c6ca9f => generated 1358 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:09:31.303010 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-62e4b03c-a518-4977-8150-3c5bf4f859b2 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:31.303706 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-62e4b03c-a518-4977-8150-3c5bf4f859b2 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:31.310741 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-62e4b03c-a518-4977-8150-3c5bf4f859b2 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:31.312155 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-62e4b03c-a518-4977-8150-3c5bf4f859b2 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:31.313051 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-62e4b03c-a518-4977-8150-3c5bf4f859b2 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:31.313491 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-62e4b03c-a518-4977-8150-3c5bf4f859b2 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:31.345546 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-211228e0-368b-4693-bf41-b20b12a395bc tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:31.347226 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-211228e0-368b-4693-bf41-b20b12a395bc tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] [instance: ec5e47ac-761b-467f-958c-516a9f8bc3e6] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:31.357854 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-211228e0-368b-4693-bf41-b20b12a395bc tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:31.359602 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-211228e0-368b-4693-bf41-b20b12a395bc tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:31.361245 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-211228e0-368b-4693-bf41-b20b12a395bc tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:31.365627 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-211228e0-368b-4693-bf41-b20b12a395bc tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:31.403743 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-211228e0-368b-4693-bf41-b20b12a395bc tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] 10.222.0.79 "GET /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.061065 Jan 28 02:09:31.403743 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 314/593] 10.222.0.79 () {58 vars in 1301 bytes} [Fri Jan 28 02:09:31 2022] GET /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6/os-volume_attachments => generated 25 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 02:09:31.537207 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-62e4b03c-a518-4977-8150-3c5bf4f859b2 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:31.550811 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-62e4b03c-a518-4977-8150-3c5bf4f859b2 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:31.552363 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-62e4b03c-a518-4977-8150-3c5bf4f859b2 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:31.553764 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-62e4b03c-a518-4977-8150-3c5bf4f859b2 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84" status: 200 len: 1808 microversion: 2.20 time: 0.255102 Jan 28 02:09:31.562772 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 280/594] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:09:31 2022] GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84 => generated 1808 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:09:32.161013 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-aff65499-e891-4693-b750-e51096b14fa4 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:32.161490 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-aff65499-e891-4693-b750-e51096b14fa4 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] [instance: 086c6296-168f-46fc-9ec4-8700b7c6ca9f] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:32.167875 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-aff65499-e891-4693-b750-e51096b14fa4 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:32.168231 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-aff65499-e891-4693-b750-e51096b14fa4 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:32.168740 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-aff65499-e891-4693-b750-e51096b14fa4 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:32.169175 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-aff65499-e891-4693-b750-e51096b14fa4 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:32.320810 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-aff65499-e891-4693-b750-e51096b14fa4 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14f6f890deb74eadab6b1ff4b6431036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e991e35dc5b463fbf9f08db0e72cf46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:32.329722 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-aff65499-e891-4693-b750-e51096b14fa4 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] 10.222.0.79 "GET /compute/v2.1/servers/086c6296-168f-46fc-9ec4-8700b7c6ca9f" status: 200 len: 1547 microversion: 2.1 time: 0.172515 Jan 28 02:09:32.330209 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 315/595] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:09:32 2022] GET /compute/v2.1/servers/086c6296-168f-46fc-9ec4-8700b7c6ca9f => generated 1547 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:09:32.346523 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-a60343d4-5c3c-480b-a87f-4e7d416d54ae tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:32.347125 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-a60343d4-5c3c-480b-a87f-4e7d416d54ae tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] [instance: 086c6296-168f-46fc-9ec4-8700b7c6ca9f] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:32.353507 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a60343d4-5c3c-480b-a87f-4e7d416d54ae tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:32.354194 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a60343d4-5c3c-480b-a87f-4e7d416d54ae tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:32.354764 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a60343d4-5c3c-480b-a87f-4e7d416d54ae tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:32.355192 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a60343d4-5c3c-480b-a87f-4e7d416d54ae tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:32.487640 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-a60343d4-5c3c-480b-a87f-4e7d416d54ae tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14f6f890deb74eadab6b1ff4b6431036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e991e35dc5b463fbf9f08db0e72cf46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:32.496066 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-a60343d4-5c3c-480b-a87f-4e7d416d54ae tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] 10.222.0.79 "GET /compute/v2.1/servers/086c6296-168f-46fc-9ec4-8700b7c6ca9f" status: 200 len: 1547 microversion: 2.1 time: 0.154316 Jan 28 02:09:32.496633 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 281/596] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:09:32 2022] GET /compute/v2.1/servers/086c6296-168f-46fc-9ec4-8700b7c6ca9f => generated 1547 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:09:32.513047 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-0dcf62a8-ffb2-47e4-9e86-a1d487679046 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:32.518794 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:09:32.518794 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: warnings.warn(msg) Jan 28 02:09:32.523449 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-0dcf62a8-ffb2-47e4-9e86-a1d487679046 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '14f6f890deb74eadab6b1ff4b6431036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e991e35dc5b463fbf9f08db0e72cf46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:32.523449 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-0dcf62a8-ffb2-47e4-9e86-a1d487679046 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Searching by: {'deleted': False, 'project_id': '2e991e35dc5b463fbf9f08db0e72cf46'} {{(pid=116374) get_all /opt/stack/nova/nova/compute/api.py:2905}} Jan 28 02:09:32.529726 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-0dcf62a8-ffb2-47e4-9e86-a1d487679046 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:32.530767 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-0dcf62a8-ffb2-47e4-9e86-a1d487679046 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:32.531835 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-0dcf62a8-ffb2-47e4-9e86-a1d487679046 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:32.532368 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-0dcf62a8-ffb2-47e4-9e86-a1d487679046 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:32.586930 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-bda86c8c-c666-4ace-a4b2-526b1367d5be tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:32.587451 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-bda86c8c-c666-4ace-a4b2-526b1367d5be tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:32.600883 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-bda86c8c-c666-4ace-a4b2-526b1367d5be tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:32.601336 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-bda86c8c-c666-4ace-a4b2-526b1367d5be tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:32.602128 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-bda86c8c-c666-4ace-a4b2-526b1367d5be tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:32.602599 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-bda86c8c-c666-4ace-a4b2-526b1367d5be tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:32.646512 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.multi_cell_list [None req-0dcf62a8-ffb2-47e4-9e86-a1d487679046 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=116374) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} Jan 28 02:09:32.776929 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-0dcf62a8-ffb2-47e4-9e86-a1d487679046 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] 10.222.0.79 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.268136 Jan 28 02:09:32.778548 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 316/597] 10.222.0.79 () {58 vars in 1124 bytes} [Fri Jan 28 02:09:32 2022] GET /compute/v2.1/servers => generated 343 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 02:09:32.806714 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-e7b8bacb-b421-4167-bb10-7984a4e92e1c tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:32.807335 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-e7b8bacb-b421-4167-bb10-7984a4e92e1c tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] [instance: 086c6296-168f-46fc-9ec4-8700b7c6ca9f] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:32.815398 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-e7b8bacb-b421-4167-bb10-7984a4e92e1c tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:32.816492 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-e7b8bacb-b421-4167-bb10-7984a4e92e1c tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:32.817333 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-e7b8bacb-b421-4167-bb10-7984a4e92e1c tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:32.818133 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-e7b8bacb-b421-4167-bb10-7984a4e92e1c tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:32.832870 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-bda86c8c-c666-4ace-a4b2-526b1367d5be tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:32.837702 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-bda86c8c-c666-4ace-a4b2-526b1367d5be tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:32.840277 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-bda86c8c-c666-4ace-a4b2-526b1367d5be tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:32.842246 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-bda86c8c-c666-4ace-a4b2-526b1367d5be tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84" status: 200 len: 1808 microversion: 2.20 time: 0.259342 Jan 28 02:09:32.843856 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 282/598] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:09:32 2022] GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84 => generated 1808 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:09:33.018094 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-e7b8bacb-b421-4167-bb10-7984a4e92e1c tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14f6f890deb74eadab6b1ff4b6431036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e991e35dc5b463fbf9f08db0e72cf46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:33.038677 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-e7b8bacb-b421-4167-bb10-7984a4e92e1c tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] 10.222.0.79 "GET /compute/v2.1/servers/086c6296-168f-46fc-9ec4-8700b7c6ca9f" status: 200 len: 1547 microversion: 2.1 time: 0.239837 Jan 28 02:09:33.038677 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 317/599] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:09:32 2022] GET /compute/v2.1/servers/086c6296-168f-46fc-9ec4-8700b7c6ca9f => generated 1547 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:09:33.863624 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-4baa995b-2670-4051-b4cd-e610378ea861 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:33.864238 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-4baa995b-2670-4051-b4cd-e610378ea861 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:33.872790 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-4baa995b-2670-4051-b4cd-e610378ea861 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:33.873240 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-4baa995b-2670-4051-b4cd-e610378ea861 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:33.874908 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-4baa995b-2670-4051-b4cd-e610378ea861 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:33.875545 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-4baa995b-2670-4051-b4cd-e610378ea861 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:34.038712 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-4baa995b-2670-4051-b4cd-e610378ea861 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:34.048800 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-4baa995b-2670-4051-b4cd-e610378ea861 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:34.050912 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-4baa995b-2670-4051-b4cd-e610378ea861 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:34.052794 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-4baa995b-2670-4051-b4cd-e610378ea861 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84" status: 200 len: 1808 microversion: 2.20 time: 0.194914 Jan 28 02:09:34.054854 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 318/600] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:09:33 2022] GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84 => generated 1808 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 02:09:34.092464 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-caf76ca9-769d-4dff-bb8e-fbebbc1815c1 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Action: 'create', calling method: .version_select at 0x7f836fde14c0>, body: {"keypair": {"name": "tempest-TestShelveInstance-740833808"}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:09:34.114692 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.quota [None req-caf76ca9-769d-4dff-bb8e-fbebbc1815c1 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Getting quotas for project a55dde8892fa47bd9941bb1ce9aa3673. Resources: {'key_pairs'} {{(pid=116375) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 02:09:34.117982 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.quota [None req-caf76ca9-769d-4dff-bb8e-fbebbc1815c1 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Getting quotas for user bb5c39b83f31473696c9b249ab49d780 and project a55dde8892fa47bd9941bb1ce9aa3673. Resources: {'key_pairs'} {{(pid=116375) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 02:09:34.141020 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: ERROR oslo.messaging._drivers.impl_rabbit [None req-caf76ca9-769d-4dff-bb8e-fbebbc1815c1 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] [dbd419ab-d320-4d38-8415-8554f4710854] AMQP server on 10.222.0.79:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jan 28 02:09:34.356930 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-4820cf39-4155-421a-8499-80a60b1ed472 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:34.357457 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-4820cf39-4155-421a-8499-80a60b1ed472 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] [instance: 2f0bfba5-38f6-4375-a6bf-25959ad11fe0] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:34.364014 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-4820cf39-4155-421a-8499-80a60b1ed472 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:34.364625 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-4820cf39-4155-421a-8499-80a60b1ed472 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:34.365268 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-4820cf39-4155-421a-8499-80a60b1ed472 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:34.365699 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-4820cf39-4155-421a-8499-80a60b1ed472 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:34.390596 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-4820cf39-4155-421a-8499-80a60b1ed472 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] [instance: 2f0bfba5-38f6-4375-a6bf-25959ad11fe0] Going to try to terminate instance {{(pid=116374) delete /opt/stack/nova/nova/compute/api.py:2612}} Jan 28 02:09:34.704622 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-4820cf39-4155-421a-8499-80a60b1ed472 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] 10.222.0.79 "DELETE /compute/v2.1/servers/2f0bfba5-38f6-4375-a6bf-25959ad11fe0" status: 204 len: 0 microversion: 2.1 time: 0.350375 Jan 28 02:09:34.705320 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 319/601] 10.222.0.79 () {58 vars in 1238 bytes} [Fri Jan 28 02:09:34 2022] DELETE /compute/v2.1/servers/2f0bfba5-38f6-4375-a6bf-25959ad11fe0 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 28 02:09:34.713872 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-1e071eae-bf5b-4774-822b-b4e065563f3d tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:34.714552 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-1e071eae-bf5b-4774-822b-b4e065563f3d tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] [instance: 2f0bfba5-38f6-4375-a6bf-25959ad11fe0] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:34.721248 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-1e071eae-bf5b-4774-822b-b4e065563f3d tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:34.721686 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-1e071eae-bf5b-4774-822b-b4e065563f3d tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:34.722436 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-1e071eae-bf5b-4774-822b-b4e065563f3d tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:34.722857 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-1e071eae-bf5b-4774-822b-b4e065563f3d tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:34.854702 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-1e071eae-bf5b-4774-822b-b4e065563f3d tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd7039b8f074a13b2030a2bb7aaff94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc19a0f9c33f47f1b504bebbb0b2c931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:34.862489 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-1e071eae-bf5b-4774-822b-b4e065563f3d tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] 10.222.0.79 "GET /compute/v2.1/servers/2f0bfba5-38f6-4375-a6bf-25959ad11fe0" status: 200 len: 1507 microversion: 2.1 time: 0.152869 Jan 28 02:09:34.863282 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 320/602] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:09:34 2022] GET /compute/v2.1/servers/2f0bfba5-38f6-4375-a6bf-25959ad11fe0 => generated 1507 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:09:35.085080 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-2f3a484c-6839-48fd-9203-f696e6cec23e tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:35.085744 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-2f3a484c-6839-48fd-9203-f696e6cec23e tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:35.091629 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-2f3a484c-6839-48fd-9203-f696e6cec23e tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:35.092303 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-2f3a484c-6839-48fd-9203-f696e6cec23e tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:35.093074 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-2f3a484c-6839-48fd-9203-f696e6cec23e tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:35.093500 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-2f3a484c-6839-48fd-9203-f696e6cec23e tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:35.152708 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO oslo.messaging._drivers.impl_rabbit [None req-caf76ca9-769d-4dff-bb8e-fbebbc1815c1 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] [dbd419ab-d320-4d38-8415-8554f4710854] Reconnected to AMQP server on 10.222.0.79:5672 via [amqp] client with port 36362. Jan 28 02:09:35.271486 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-2f3a484c-6839-48fd-9203-f696e6cec23e tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:35.285826 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-2f3a484c-6839-48fd-9203-f696e6cec23e tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:35.288461 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-2f3a484c-6839-48fd-9203-f696e6cec23e tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:35.290118 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-2f3a484c-6839-48fd-9203-f696e6cec23e tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84" status: 200 len: 1808 microversion: 2.20 time: 0.209291 Jan 28 02:09:35.290681 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 321/603] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:09:35 2022] GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84 => generated 1808 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:09:35.296608 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-b86b4858-a943-4906-baf1-822c325f5961 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e4ea420f-5a33-45f1-a33f-a7f1253addd2"}} {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:09:35.298571 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-b86b4858-a943-4906-baf1-822c325f5961 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] [instance: 086c6296-168f-46fc-9ec4-8700b7c6ca9f] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:35.305340 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-b86b4858-a943-4906-baf1-822c325f5961 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:35.306000 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-b86b4858-a943-4906-baf1-822c325f5961 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:35.307096 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-b86b4858-a943-4906-baf1-822c325f5961 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:35.307564 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-b86b4858-a943-4906-baf1-822c325f5961 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:35.572377 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.quota [None req-caf76ca9-769d-4dff-bb8e-fbebbc1815c1 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Getting quotas for project a55dde8892fa47bd9941bb1ce9aa3673. Resources: {'key_pairs'} {{(pid=116375) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 02:09:35.576220 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.quota [None req-caf76ca9-769d-4dff-bb8e-fbebbc1815c1 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Getting quotas for user bb5c39b83f31473696c9b249ab49d780 and project a55dde8892fa47bd9941bb1ce9aa3673. Resources: {'key_pairs'} {{(pid=116375) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 02:09:35.590229 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-caf76ca9-769d-4dff-bb8e-fbebbc1815c1 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 2315 microversion: 2.1 time: 1.813680 Jan 28 02:09:35.590822 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 283/604] 10.222.0.79 () {60 vars in 1157 bytes} [Fri Jan 28 02:09:33 2022] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 1815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:09:35.883342 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-160ccdba-d984-4cb6-9a36-0fa16017fd9c tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:35.889481 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-160ccdba-d984-4cb6-9a36-0fa16017fd9c tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] [instance: 2f0bfba5-38f6-4375-a6bf-25959ad11fe0] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:35.894570 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-160ccdba-d984-4cb6-9a36-0fa16017fd9c tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:35.895173 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-160ccdba-d984-4cb6-9a36-0fa16017fd9c tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:35.896461 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-160ccdba-d984-4cb6-9a36-0fa16017fd9c tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:35.897692 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-160ccdba-d984-4cb6-9a36-0fa16017fd9c tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:36.050535 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-160ccdba-d984-4cb6-9a36-0fa16017fd9c tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd7039b8f074a13b2030a2bb7aaff94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc19a0f9c33f47f1b504bebbb0b2c931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:36.060343 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-160ccdba-d984-4cb6-9a36-0fa16017fd9c tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] 10.222.0.79 "GET /compute/v2.1/servers/2f0bfba5-38f6-4375-a6bf-25959ad11fe0" status: 200 len: 1507 microversion: 2.1 time: 0.183735 Jan 28 02:09:36.061236 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 284/605] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:09:35 2022] GET /compute/v2.1/servers/2f0bfba5-38f6-4375-a6bf-25959ad11fe0 => generated 1507 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:09:36.157934 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-b86b4858-a943-4906-baf1-822c325f5961 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] 10.222.0.79 "POST /compute/v2.1/servers/086c6296-168f-46fc-9ec4-8700b7c6ca9f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.865294 Jan 28 02:09:36.163139 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 322/606] 10.222.0.79 () {60 vars in 1322 bytes} [Fri Jan 28 02:09:35 2022] POST /compute/v2.1/servers/086c6296-168f-46fc-9ec4-8700b7c6ca9f/os-volume_attachments => generated 194 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:09:36.310715 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-c7112da7-b483-43f9-90e1-7ff518639120 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:36.311351 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-c7112da7-b483-43f9-90e1-7ff518639120 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:36.317834 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c7112da7-b483-43f9-90e1-7ff518639120 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:36.318283 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c7112da7-b483-43f9-90e1-7ff518639120 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:36.319110 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c7112da7-b483-43f9-90e1-7ff518639120 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:36.319541 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c7112da7-b483-43f9-90e1-7ff518639120 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:36.474504 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-c7112da7-b483-43f9-90e1-7ff518639120 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:36.488161 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-c7112da7-b483-43f9-90e1-7ff518639120 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:36.489864 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-c7112da7-b483-43f9-90e1-7ff518639120 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:36.490957 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-c7112da7-b483-43f9-90e1-7ff518639120 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84" status: 200 len: 1808 microversion: 2.20 time: 0.184116 Jan 28 02:09:36.497063 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 285/607] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:09:36 2022] GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84 => generated 1808 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:09:37.083144 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-4c08641a-4443-4332-b50d-bd66f447a611 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:37.083887 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-4c08641a-4443-4332-b50d-bd66f447a611 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] [instance: 2f0bfba5-38f6-4375-a6bf-25959ad11fe0] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:37.092017 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-4c08641a-4443-4332-b50d-bd66f447a611 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:37.092454 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-4c08641a-4443-4332-b50d-bd66f447a611 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:37.093223 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-4c08641a-4443-4332-b50d-bd66f447a611 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:37.093647 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-4c08641a-4443-4332-b50d-bd66f447a611 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:37.244488 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-4c08641a-4443-4332-b50d-bd66f447a611 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd7039b8f074a13b2030a2bb7aaff94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc19a0f9c33f47f1b504bebbb0b2c931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:37.259313 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-4c08641a-4443-4332-b50d-bd66f447a611 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] 10.222.0.79 "GET /compute/v2.1/servers/2f0bfba5-38f6-4375-a6bf-25959ad11fe0" status: 200 len: 1507 microversion: 2.1 time: 0.184160 Jan 28 02:09:37.260133 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 323/608] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:09:37 2022] GET /compute/v2.1/servers/2f0bfba5-38f6-4375-a6bf-25959ad11fe0 => generated 1507 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:09:37.510046 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-2ddb56fe-82d6-4e39-abb3-d5466a109dec tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:37.529909 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-2ddb56fe-82d6-4e39-abb3-d5466a109dec tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:37.541593 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2ddb56fe-82d6-4e39-abb3-d5466a109dec tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:37.543764 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2ddb56fe-82d6-4e39-abb3-d5466a109dec tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:37.546217 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2ddb56fe-82d6-4e39-abb3-d5466a109dec tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:37.548519 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2ddb56fe-82d6-4e39-abb3-d5466a109dec tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:37.708256 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-2ddb56fe-82d6-4e39-abb3-d5466a109dec tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:37.720057 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-2ddb56fe-82d6-4e39-abb3-d5466a109dec tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:37.721611 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-2ddb56fe-82d6-4e39-abb3-d5466a109dec tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:37.722947 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-2ddb56fe-82d6-4e39-abb3-d5466a109dec tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84" status: 200 len: 1808 microversion: 2.20 time: 0.216751 Jan 28 02:09:37.723507 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 286/609] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:09:37 2022] GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84 => generated 1808 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:09:38.277653 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-65a6d72b-74a3-4f59-9c7e-a5b0b7e41cb2 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:38.279142 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-65a6d72b-74a3-4f59-9c7e-a5b0b7e41cb2 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] [instance: 2f0bfba5-38f6-4375-a6bf-25959ad11fe0] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:38.285957 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-65a6d72b-74a3-4f59-9c7e-a5b0b7e41cb2 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:38.286542 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-65a6d72b-74a3-4f59-9c7e-a5b0b7e41cb2 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:38.287488 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-65a6d72b-74a3-4f59-9c7e-a5b0b7e41cb2 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:38.288523 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-65a6d72b-74a3-4f59-9c7e-a5b0b7e41cb2 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:38.574669 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-65a6d72b-74a3-4f59-9c7e-a5b0b7e41cb2 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd7039b8f074a13b2030a2bb7aaff94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc19a0f9c33f47f1b504bebbb0b2c931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:38.589018 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-65a6d72b-74a3-4f59-9c7e-a5b0b7e41cb2 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] 10.222.0.79 "GET /compute/v2.1/servers/2f0bfba5-38f6-4375-a6bf-25959ad11fe0" status: 200 len: 1507 microversion: 2.1 time: 0.314929 Jan 28 02:09:38.593656 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 324/610] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:09:38 2022] GET /compute/v2.1/servers/2f0bfba5-38f6-4375-a6bf-25959ad11fe0 => generated 1507 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:09:38.741236 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-89be983a-bd70-41fc-936c-37ba8c4c07d8 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:38.741856 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-89be983a-bd70-41fc-936c-37ba8c4c07d8 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:38.748435 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-89be983a-bd70-41fc-936c-37ba8c4c07d8 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:38.748873 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-89be983a-bd70-41fc-936c-37ba8c4c07d8 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:38.749638 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-89be983a-bd70-41fc-936c-37ba8c4c07d8 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:38.750618 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-89be983a-bd70-41fc-936c-37ba8c4c07d8 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:38.919720 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [req-70866ee4-71bc-4691-b0a5-4051b8368ae6 req-c5b63363-b70e-4cd5-bce7-a2aa895cc30c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f0bfba5-38f6-4375-a6bf-25959ad11fe0", "name": "network-vif-deleted", "tag": "f563e565-6b72-491c-a99c-3004a4f17f98"}]} {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:09:38.923143 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:09:38.923143 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: warnings.warn(msg) Jan 28 02:09:38.940777 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [req-70866ee4-71bc-4691-b0a5-4051b8368ae6 req-c5b63363-b70e-4cd5-bce7-a2aa895cc30c service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:38.941439 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [req-70866ee4-71bc-4691-b0a5-4051b8368ae6 req-c5b63363-b70e-4cd5-bce7-a2aa895cc30c service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:38.958978 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-89be983a-bd70-41fc-936c-37ba8c4c07d8 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:38.970767 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-89be983a-bd70-41fc-936c-37ba8c4c07d8 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:38.972954 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-89be983a-bd70-41fc-936c-37ba8c4c07d8 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:38.973590 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.compute.server_external_events [req-70866ee4-71bc-4691-b0a5-4051b8368ae6 req-c5b63363-b70e-4cd5-bce7-a2aa895cc30c service nova] Creating event network-vif-deleted:f563e565-6b72-491c-a99c-3004a4f17f98 for instance 2f0bfba5-38f6-4375-a6bf-25959ad11fe0 on hv-cinder-82497 Jan 28 02:09:38.974777 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-89be983a-bd70-41fc-936c-37ba8c4c07d8 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84" status: 200 len: 1808 microversion: 2.20 time: 0.237307 Jan 28 02:09:38.975831 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 287/611] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:09:38 2022] GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84 => generated 1808 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:09:38.989035 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [req-70866ee4-71bc-4691-b0a5-4051b8368ae6 req-c5b63363-b70e-4cd5-bce7-a2aa895cc30c service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073530 Jan 28 02:09:38.990079 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 325/612] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Jan 28 02:09:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:09:39.610201 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-2b48d839-81a9-4ba6-87b8-aaaf0faa541f tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:39.614197 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-2b48d839-81a9-4ba6-87b8-aaaf0faa541f tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] [instance: 2f0bfba5-38f6-4375-a6bf-25959ad11fe0] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:39.616667 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-35ff964e-70cb-42bf-8479-695d7ec8be57 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e0359e21-83f0-45b8-8432-3145b1cee372"}} {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:09:39.617867 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2b48d839-81a9-4ba6-87b8-aaaf0faa541f tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:39.618470 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2b48d839-81a9-4ba6-87b8-aaaf0faa541f tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:39.618564 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-35ff964e-70cb-42bf-8479-695d7ec8be57 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] [instance: 96b38440-c5bd-4838-bd1b-46312012607e] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:39.619082 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2b48d839-81a9-4ba6-87b8-aaaf0faa541f tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:39.619515 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2b48d839-81a9-4ba6-87b8-aaaf0faa541f tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:39.624914 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-35ff964e-70cb-42bf-8479-695d7ec8be57 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:39.625581 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-35ff964e-70cb-42bf-8479-695d7ec8be57 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:39.626402 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-35ff964e-70cb-42bf-8479-695d7ec8be57 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:39.626893 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-35ff964e-70cb-42bf-8479-695d7ec8be57 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:39.651879 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2b48d839-81a9-4ba6-87b8-aaaf0faa541f tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:39.652370 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2b48d839-81a9-4ba6-87b8-aaaf0faa541f tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:39.652820 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.objects.instance [None req-2b48d839-81a9-4ba6-87b8-aaaf0faa541f tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lazy-loading 'fault' on Instance uuid 2f0bfba5-38f6-4375-a6bf-25959ad11fe0 {{(pid=116375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jan 28 02:09:39.692235 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-2b48d839-81a9-4ba6-87b8-aaaf0faa541f tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd7039b8f074a13b2030a2bb7aaff94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc19a0f9c33f47f1b504bebbb0b2c931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:39.710244 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-2b48d839-81a9-4ba6-87b8-aaaf0faa541f tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] 10.222.0.79 "GET /compute/v2.1/servers/2f0bfba5-38f6-4375-a6bf-25959ad11fe0" status: 200 len: 1311 microversion: 2.1 time: 0.103750 Jan 28 02:09:39.712183 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 288/613] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:09:39 2022] GET /compute/v2.1/servers/2f0bfba5-38f6-4375-a6bf-25959ad11fe0 => generated 1311 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:09:39.758110 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.wsgi [None req-35ff964e-70cb-42bf-8479-695d7ec8be57 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] HTTP exception thrown: Invalid volume: volume e0359e21-83f0-45b8-8432-3145b1cee372 is already attached to instances: 96b38440-c5bd-4838-bd1b-46312012607e Jan 28 02:09:39.758715 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-35ff964e-70cb-42bf-8479-695d7ec8be57 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Returning 400 to user: Invalid volume: volume e0359e21-83f0-45b8-8432-3145b1cee372 is already attached to instances: 96b38440-c5bd-4838-bd1b-46312012607e {{(pid=116374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 02:09:39.759547 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-35ff964e-70cb-42bf-8479-695d7ec8be57 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] 10.222.0.79 "POST /compute/v2.1/servers/96b38440-c5bd-4838-bd1b-46312012607e/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.149170 Jan 28 02:09:39.760535 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 326/614] 10.222.0.79 () {60 vars in 1322 bytes} [Fri Jan 28 02:09:39 2022] POST /compute/v2.1/servers/96b38440-c5bd-4838-bd1b-46312012607e/os-volume_attachments => generated 174 bytes in 151 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 28 02:09:39.993950 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-391ff9b4-0faa-4996-a1a3-c1d4e4eb3c8d tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:39.994640 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-391ff9b4-0faa-4996-a1a3-c1d4e4eb3c8d tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:40.001596 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-391ff9b4-0faa-4996-a1a3-c1d4e4eb3c8d tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:40.002044 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-391ff9b4-0faa-4996-a1a3-c1d4e4eb3c8d tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:40.002810 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-391ff9b4-0faa-4996-a1a3-c1d4e4eb3c8d tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:40.003240 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-391ff9b4-0faa-4996-a1a3-c1d4e4eb3c8d tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:40.152732 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-391ff9b4-0faa-4996-a1a3-c1d4e4eb3c8d tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:40.164115 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-391ff9b4-0faa-4996-a1a3-c1d4e4eb3c8d tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:40.165883 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-391ff9b4-0faa-4996-a1a3-c1d4e4eb3c8d tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:40.167021 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-391ff9b4-0faa-4996-a1a3-c1d4e4eb3c8d tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84" status: 200 len: 1808 microversion: 2.20 time: 0.176718 Jan 28 02:09:40.167642 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 289/615] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:09:39 2022] GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84 => generated 1808 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:09:40.418994 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-d8dcb6ab-f69a-469b-8fcf-359e25f6d0fb tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:40.419480 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-d8dcb6ab-f69a-469b-8fcf-359e25f6d0fb tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] [instance: 96b38440-c5bd-4838-bd1b-46312012607e] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:40.426462 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-d8dcb6ab-f69a-469b-8fcf-359e25f6d0fb tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:40.426818 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-d8dcb6ab-f69a-469b-8fcf-359e25f6d0fb tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:40.427782 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-d8dcb6ab-f69a-469b-8fcf-359e25f6d0fb tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:40.428251 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-d8dcb6ab-f69a-469b-8fcf-359e25f6d0fb tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:40.536044 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.objects.instance [None req-d8dcb6ab-f69a-469b-8fcf-359e25f6d0fb tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lazy-loading 'services' on Instance uuid 96b38440-c5bd-4838-bd1b-46312012607e {{(pid=116374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jan 28 02:09:40.729459 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-ff24de5a-354a-4f77-9801-bcc72cccc447 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:40.731804 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-ff24de5a-354a-4f77-9801-bcc72cccc447 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] [instance: 2f0bfba5-38f6-4375-a6bf-25959ad11fe0] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:40.738506 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ff24de5a-354a-4f77-9801-bcc72cccc447 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:40.738956 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ff24de5a-354a-4f77-9801-bcc72cccc447 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:40.739783 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ff24de5a-354a-4f77-9801-bcc72cccc447 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:40.740538 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ff24de5a-354a-4f77-9801-bcc72cccc447 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:40.754830 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.wsgi [None req-ff24de5a-354a-4f77-9801-bcc72cccc447 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] HTTP exception thrown: Instance 2f0bfba5-38f6-4375-a6bf-25959ad11fe0 could not be found. Jan 28 02:09:40.755329 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-ff24de5a-354a-4f77-9801-bcc72cccc447 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Returning 404 to user: Instance 2f0bfba5-38f6-4375-a6bf-25959ad11fe0 could not be found. {{(pid=116375) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 02:09:40.756193 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-ff24de5a-354a-4f77-9801-bcc72cccc447 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] 10.222.0.79 "GET /compute/v2.1/servers/2f0bfba5-38f6-4375-a6bf-25959ad11fe0" status: 404 len: 111 microversion: 2.1 time: 0.031046 Jan 28 02:09:40.756744 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 290/616] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:09:40 2022] GET /compute/v2.1/servers/2f0bfba5-38f6-4375-a6bf-25959ad11fe0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 28 02:09:40.764341 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-5ba1489d-1c42-4cfc-9670-d4efd0fe1391 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:40.764833 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-5ba1489d-1c42-4cfc-9670-d4efd0fe1391 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] [instance: ec5e47ac-761b-467f-958c-516a9f8bc3e6] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:40.770713 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-5ba1489d-1c42-4cfc-9670-d4efd0fe1391 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:40.771163 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-5ba1489d-1c42-4cfc-9670-d4efd0fe1391 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:40.775184 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-5ba1489d-1c42-4cfc-9670-d4efd0fe1391 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:40.775184 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-5ba1489d-1c42-4cfc-9670-d4efd0fe1391 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:40.797980 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-5ba1489d-1c42-4cfc-9670-d4efd0fe1391 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] [instance: ec5e47ac-761b-467f-958c-516a9f8bc3e6] Going to try to terminate instance {{(pid=116375) delete /opt/stack/nova/nova/compute/api.py:2612}} Jan 28 02:09:40.801076 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-d8dcb6ab-f69a-469b-8fcf-359e25f6d0fb tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] 10.222.0.79 "DELETE /compute/v2.1/servers/96b38440-c5bd-4838-bd1b-46312012607e/os-volume_attachments/e0359e21-83f0-45b8-8432-3145b1cee372" status: 202 len: 0 microversion: 2.1 time: 0.386179 Jan 28 02:09:40.801882 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 327/617] 10.222.0.79 () {58 vars in 1415 bytes} [Fri Jan 28 02:09:40 2022] DELETE /compute/v2.1/servers/96b38440-c5bd-4838-bd1b-46312012607e/os-volume_attachments/e0359e21-83f0-45b8-8432-3145b1cee372 => generated 0 bytes in 388 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:09:40.810293 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-daeec9b2-3bb8-41d1-88b6-5aaa5782d2ba tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:40.811361 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-daeec9b2-3bb8-41d1-88b6-5aaa5782d2ba tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] [instance: 96b38440-c5bd-4838-bd1b-46312012607e] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:40.818251 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-daeec9b2-3bb8-41d1-88b6-5aaa5782d2ba tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:40.818708 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-daeec9b2-3bb8-41d1-88b6-5aaa5782d2ba tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:40.819488 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-daeec9b2-3bb8-41d1-88b6-5aaa5782d2ba tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:40.819923 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-daeec9b2-3bb8-41d1-88b6-5aaa5782d2ba tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:40.850832 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-daeec9b2-3bb8-41d1-88b6-5aaa5782d2ba tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] 10.222.0.79 "GET /compute/v2.1/servers/96b38440-c5bd-4838-bd1b-46312012607e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044382 Jan 28 02:09:40.851410 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 328/618] 10.222.0.79 () {58 vars in 1301 bytes} [Fri Jan 28 02:09:40 2022] GET /compute/v2.1/servers/96b38440-c5bd-4838-bd1b-46312012607e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 02:09:41.107368 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-5ba1489d-1c42-4cfc-9670-d4efd0fe1391 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] 10.222.0.79 "DELETE /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6" status: 204 len: 0 microversion: 2.1 time: 0.346110 Jan 28 02:09:41.107933 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 291/619] 10.222.0.79 () {58 vars in 1238 bytes} [Fri Jan 28 02:09:40 2022] DELETE /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 28 02:09:41.115921 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-40a130ee-16e6-47e5-a629-67c994de2160 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:41.116631 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-40a130ee-16e6-47e5-a629-67c994de2160 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] [instance: ec5e47ac-761b-467f-958c-516a9f8bc3e6] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:41.123252 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-40a130ee-16e6-47e5-a629-67c994de2160 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:41.123684 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-40a130ee-16e6-47e5-a629-67c994de2160 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:41.124505 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-40a130ee-16e6-47e5-a629-67c994de2160 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:41.125635 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-40a130ee-16e6-47e5-a629-67c994de2160 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:41.188563 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-1edebff1-e329-4d90-adea-bc2a2136d343 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:41.189293 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-1edebff1-e329-4d90-adea-bc2a2136d343 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:41.195178 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-1edebff1-e329-4d90-adea-bc2a2136d343 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:41.195614 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-1edebff1-e329-4d90-adea-bc2a2136d343 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:41.196827 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-1edebff1-e329-4d90-adea-bc2a2136d343 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:41.196946 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-1edebff1-e329-4d90-adea-bc2a2136d343 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:41.267283 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-40a130ee-16e6-47e5-a629-67c994de2160 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd7039b8f074a13b2030a2bb7aaff94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc19a0f9c33f47f1b504bebbb0b2c931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:41.275190 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-40a130ee-16e6-47e5-a629-67c994de2160 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] 10.222.0.79 "GET /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6" status: 200 len: 1521 microversion: 2.1 time: 0.162873 Jan 28 02:09:41.276229 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 329/620] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:09:41 2022] GET /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:09:41.346103 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-1edebff1-e329-4d90-adea-bc2a2136d343 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:41.354400 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-1edebff1-e329-4d90-adea-bc2a2136d343 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:41.355889 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-1edebff1-e329-4d90-adea-bc2a2136d343 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:41.357125 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-1edebff1-e329-4d90-adea-bc2a2136d343 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84" status: 200 len: 1808 microversion: 2.20 time: 0.174186 Jan 28 02:09:41.357763 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 292/621] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:09:41 2022] GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84 => generated 1808 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:09:41.863372 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-e07e7361-085e-4b3a-a2ca-a0b3d03b8c67 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:41.864432 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-e07e7361-085e-4b3a-a2ca-a0b3d03b8c67 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] [instance: 96b38440-c5bd-4838-bd1b-46312012607e] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:41.870422 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-e07e7361-085e-4b3a-a2ca-a0b3d03b8c67 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:41.870805 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-e07e7361-085e-4b3a-a2ca-a0b3d03b8c67 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:41.871560 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-e07e7361-085e-4b3a-a2ca-a0b3d03b8c67 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:41.872036 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-e07e7361-085e-4b3a-a2ca-a0b3d03b8c67 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:41.901789 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-e07e7361-085e-4b3a-a2ca-a0b3d03b8c67 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] 10.222.0.79 "GET /compute/v2.1/servers/96b38440-c5bd-4838-bd1b-46312012607e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042925 Jan 28 02:09:41.902344 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 330/622] 10.222.0.79 () {58 vars in 1301 bytes} [Fri Jan 28 02:09:41 2022] GET /compute/v2.1/servers/96b38440-c5bd-4838-bd1b-46312012607e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:09:42.293208 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-a6885a23-5a59-43cb-8f04-632117b4dc61 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:42.293877 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-a6885a23-5a59-43cb-8f04-632117b4dc61 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] [instance: ec5e47ac-761b-467f-958c-516a9f8bc3e6] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:42.300174 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a6885a23-5a59-43cb-8f04-632117b4dc61 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:42.300616 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a6885a23-5a59-43cb-8f04-632117b4dc61 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:42.302847 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a6885a23-5a59-43cb-8f04-632117b4dc61 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:42.302847 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a6885a23-5a59-43cb-8f04-632117b4dc61 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:42.377822 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-6518b7bb-e9b2-4120-a87f-2cb9ea24454f tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:42.378526 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-6518b7bb-e9b2-4120-a87f-2cb9ea24454f tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:42.389000 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-6518b7bb-e9b2-4120-a87f-2cb9ea24454f tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:42.389772 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-6518b7bb-e9b2-4120-a87f-2cb9ea24454f tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:42.391474 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-6518b7bb-e9b2-4120-a87f-2cb9ea24454f tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:42.392163 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-6518b7bb-e9b2-4120-a87f-2cb9ea24454f tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:42.483209 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-a6885a23-5a59-43cb-8f04-632117b4dc61 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd7039b8f074a13b2030a2bb7aaff94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc19a0f9c33f47f1b504bebbb0b2c931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:42.493917 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-a6885a23-5a59-43cb-8f04-632117b4dc61 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] 10.222.0.79 "GET /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6" status: 200 len: 1521 microversion: 2.1 time: 0.204406 Jan 28 02:09:42.493917 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 293/623] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:09:42 2022] GET /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6 => generated 1521 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:09:42.556056 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-6518b7bb-e9b2-4120-a87f-2cb9ea24454f tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:42.566660 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-6518b7bb-e9b2-4120-a87f-2cb9ea24454f tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:42.568369 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-6518b7bb-e9b2-4120-a87f-2cb9ea24454f tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:42.569722 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-6518b7bb-e9b2-4120-a87f-2cb9ea24454f tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84" status: 200 len: 1808 microversion: 2.20 time: 0.197017 Jan 28 02:09:42.572506 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 331/624] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:09:42 2022] GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84 => generated 1808 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 02:09:42.576408 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [req-14b8b7cc-bbfa-4f38-9be9-5f641c0f1475 req-8bfdb5cd-01c2-4381-a120-9b403ea2f3c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f25403b-0399-48d0-86a9-6e5022287c84", "name": "network-vif-plugged", "status": "completed", "tag": "eb8f729a-b66f-4c5c-a62e-472c346922bb"}]} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:09:42.578765 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:09:42.578765 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: warnings.warn(msg) Jan 28 02:09:42.587599 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-14b8b7cc-bbfa-4f38-9be9-5f641c0f1475 req-8bfdb5cd-01c2-4381-a120-9b403ea2f3c9 service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:42.588084 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-14b8b7cc-bbfa-4f38-9be9-5f641c0f1475 req-8bfdb5cd-01c2-4381-a120-9b403ea2f3c9 service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:42.602243 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.compute.server_external_events [req-14b8b7cc-bbfa-4f38-9be9-5f641c0f1475 req-8bfdb5cd-01c2-4381-a120-9b403ea2f3c9 service nova] Creating event network-vif-plugged:eb8f729a-b66f-4c5c-a62e-472c346922bb for instance 4f25403b-0399-48d0-86a9-6e5022287c84 on hv-cinder-82497 Jan 28 02:09:42.606258 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [req-14b8b7cc-bbfa-4f38-9be9-5f641c0f1475 req-8bfdb5cd-01c2-4381-a120-9b403ea2f3c9 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033314 Jan 28 02:09:42.607419 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 294/625] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Jan 28 02:09:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:09:42.912485 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-fcb70f76-835e-4e29-8eb9-2978af26e23b tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:42.913438 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-fcb70f76-835e-4e29-8eb9-2978af26e23b tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] [instance: 96b38440-c5bd-4838-bd1b-46312012607e] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:42.919309 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-fcb70f76-835e-4e29-8eb9-2978af26e23b tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:42.919747 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-fcb70f76-835e-4e29-8eb9-2978af26e23b tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:42.920521 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-fcb70f76-835e-4e29-8eb9-2978af26e23b tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:42.920945 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-fcb70f76-835e-4e29-8eb9-2978af26e23b tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:42.951843 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-fcb70f76-835e-4e29-8eb9-2978af26e23b tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] 10.222.0.79 "GET /compute/v2.1/servers/96b38440-c5bd-4838-bd1b-46312012607e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043157 Jan 28 02:09:42.952689 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 332/626] 10.222.0.79 () {58 vars in 1301 bytes} [Fri Jan 28 02:09:42 2022] GET /compute/v2.1/servers/96b38440-c5bd-4838-bd1b-46312012607e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:09:43.511326 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-299906e2-0d0a-4ba3-a686-4c5f4252b44d tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:43.512091 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-299906e2-0d0a-4ba3-a686-4c5f4252b44d tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] [instance: ec5e47ac-761b-467f-958c-516a9f8bc3e6] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:43.521929 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-299906e2-0d0a-4ba3-a686-4c5f4252b44d tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:43.521929 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-299906e2-0d0a-4ba3-a686-4c5f4252b44d tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:43.521929 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-299906e2-0d0a-4ba3-a686-4c5f4252b44d tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:43.521929 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-299906e2-0d0a-4ba3-a686-4c5f4252b44d tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:43.589620 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-80895488-be34-4468-b01d-9571d5bbbeaf tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:43.590302 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-80895488-be34-4468-b01d-9571d5bbbeaf tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:43.598366 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-80895488-be34-4468-b01d-9571d5bbbeaf tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:43.598719 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-80895488-be34-4468-b01d-9571d5bbbeaf tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:43.599484 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-80895488-be34-4468-b01d-9571d5bbbeaf tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:43.599921 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-80895488-be34-4468-b01d-9571d5bbbeaf tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:43.688184 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-299906e2-0d0a-4ba3-a686-4c5f4252b44d tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd7039b8f074a13b2030a2bb7aaff94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc19a0f9c33f47f1b504bebbb0b2c931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:43.696912 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-299906e2-0d0a-4ba3-a686-4c5f4252b44d tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] 10.222.0.79 "GET /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6" status: 200 len: 1521 microversion: 2.1 time: 0.189591 Jan 28 02:09:43.697969 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 295/627] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:09:43 2022] GET /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6 => generated 1521 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:09:43.754208 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-80895488-be34-4468-b01d-9571d5bbbeaf tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:43.774664 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-80895488-be34-4468-b01d-9571d5bbbeaf tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:43.776989 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-80895488-be34-4468-b01d-9571d5bbbeaf tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:43.777702 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-80895488-be34-4468-b01d-9571d5bbbeaf tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84" status: 200 len: 1808 microversion: 2.20 time: 0.191751 Jan 28 02:09:43.780163 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 333/628] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:09:43 2022] GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84 => generated 1808 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 02:09:43.962653 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-2403617f-0e1a-48d8-ac8a-b6eec75cc975 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:43.963473 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-2403617f-0e1a-48d8-ac8a-b6eec75cc975 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] [instance: 96b38440-c5bd-4838-bd1b-46312012607e] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:43.969855 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2403617f-0e1a-48d8-ac8a-b6eec75cc975 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:43.970290 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2403617f-0e1a-48d8-ac8a-b6eec75cc975 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:43.971042 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2403617f-0e1a-48d8-ac8a-b6eec75cc975 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:43.971462 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2403617f-0e1a-48d8-ac8a-b6eec75cc975 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:44.000589 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-2403617f-0e1a-48d8-ac8a-b6eec75cc975 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] 10.222.0.79 "GET /compute/v2.1/servers/96b38440-c5bd-4838-bd1b-46312012607e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041702 Jan 28 02:09:44.001139 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 296/629] 10.222.0.79 () {58 vars in 1301 bytes} [Fri Jan 28 02:09:43 2022] GET /compute/v2.1/servers/96b38440-c5bd-4838-bd1b-46312012607e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:09:44.713047 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-2100191f-4a78-4580-a999-a7446479858a tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:44.713648 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-2100191f-4a78-4580-a999-a7446479858a tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] [instance: ec5e47ac-761b-467f-958c-516a9f8bc3e6] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:44.719842 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-2100191f-4a78-4580-a999-a7446479858a tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:44.720328 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-2100191f-4a78-4580-a999-a7446479858a tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:44.721088 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-2100191f-4a78-4580-a999-a7446479858a tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:44.721597 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-2100191f-4a78-4580-a999-a7446479858a tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:44.797350 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-971da0c4-bfc4-41ae-950e-8c95a9ad8fa6 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:44.798425 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-971da0c4-bfc4-41ae-950e-8c95a9ad8fa6 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:44.804823 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-971da0c4-bfc4-41ae-950e-8c95a9ad8fa6 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:44.805699 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-971da0c4-bfc4-41ae-950e-8c95a9ad8fa6 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:44.806024 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-971da0c4-bfc4-41ae-950e-8c95a9ad8fa6 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:44.806627 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-971da0c4-bfc4-41ae-950e-8c95a9ad8fa6 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:44.866196 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-2100191f-4a78-4580-a999-a7446479858a tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd7039b8f074a13b2030a2bb7aaff94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc19a0f9c33f47f1b504bebbb0b2c931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:44.874043 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-2100191f-4a78-4580-a999-a7446479858a tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] 10.222.0.79 "GET /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6" status: 200 len: 1521 microversion: 2.1 time: 0.164822 Jan 28 02:09:44.874606 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 334/630] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:09:44 2022] GET /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:09:44.946012 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-971da0c4-bfc4-41ae-950e-8c95a9ad8fa6 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:44.954770 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-971da0c4-bfc4-41ae-950e-8c95a9ad8fa6 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:44.956311 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-971da0c4-bfc4-41ae-950e-8c95a9ad8fa6 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:44.957449 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-971da0c4-bfc4-41ae-950e-8c95a9ad8fa6 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84" status: 200 len: 1808 microversion: 2.20 time: 0.165147 Jan 28 02:09:44.958000 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 297/631] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:09:44 2022] GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84 => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:09:45.011329 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-9eb20168-0cf6-4cc1-ab1e-d3f653f330ee tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:45.016364 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-9eb20168-0cf6-4cc1-ab1e-d3f653f330ee tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] [instance: 96b38440-c5bd-4838-bd1b-46312012607e] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:45.019904 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-9eb20168-0cf6-4cc1-ab1e-d3f653f330ee tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:45.020317 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-9eb20168-0cf6-4cc1-ab1e-d3f653f330ee tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:45.021076 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-9eb20168-0cf6-4cc1-ab1e-d3f653f330ee tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:45.021543 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-9eb20168-0cf6-4cc1-ab1e-d3f653f330ee tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:45.050626 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-9eb20168-0cf6-4cc1-ab1e-d3f653f330ee tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] 10.222.0.79 "GET /compute/v2.1/servers/96b38440-c5bd-4838-bd1b-46312012607e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043060 Jan 28 02:09:45.051174 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 335/632] 10.222.0.79 () {58 vars in 1301 bytes} [Fri Jan 28 02:09:45 2022] GET /compute/v2.1/servers/96b38440-c5bd-4838-bd1b-46312012607e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:09:45.894699 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-45f64b01-dd69-4cf5-905b-2c4865247479 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:45.894699 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-45f64b01-dd69-4cf5-905b-2c4865247479 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] [instance: ec5e47ac-761b-467f-958c-516a9f8bc3e6] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:45.900242 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-45f64b01-dd69-4cf5-905b-2c4865247479 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:45.900690 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-45f64b01-dd69-4cf5-905b-2c4865247479 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:45.901522 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-45f64b01-dd69-4cf5-905b-2c4865247479 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:45.901946 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-45f64b01-dd69-4cf5-905b-2c4865247479 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:45.975735 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-50a18d92-e872-4776-9378-b51cf1a8a171 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:45.976455 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-50a18d92-e872-4776-9378-b51cf1a8a171 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:45.982949 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-50a18d92-e872-4776-9378-b51cf1a8a171 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:45.983454 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-50a18d92-e872-4776-9378-b51cf1a8a171 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:45.985288 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-50a18d92-e872-4776-9378-b51cf1a8a171 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:45.985604 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-50a18d92-e872-4776-9378-b51cf1a8a171 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:46.038785 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-45f64b01-dd69-4cf5-905b-2c4865247479 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd7039b8f074a13b2030a2bb7aaff94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc19a0f9c33f47f1b504bebbb0b2c931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:46.046030 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-45f64b01-dd69-4cf5-905b-2c4865247479 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] 10.222.0.79 "GET /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6" status: 200 len: 1521 microversion: 2.1 time: 0.156216 Jan 28 02:09:46.046593 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 298/633] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:09:45 2022] GET /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:09:46.063892 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-39e4dc1f-ad0e-4c6c-88a0-0661e8cec8f7 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:46.065114 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-39e4dc1f-ad0e-4c6c-88a0-0661e8cec8f7 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] [instance: 96b38440-c5bd-4838-bd1b-46312012607e] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:46.071188 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-39e4dc1f-ad0e-4c6c-88a0-0661e8cec8f7 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:46.071624 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-39e4dc1f-ad0e-4c6c-88a0-0661e8cec8f7 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:46.072636 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-39e4dc1f-ad0e-4c6c-88a0-0661e8cec8f7 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:46.073064 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-39e4dc1f-ad0e-4c6c-88a0-0661e8cec8f7 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:46.105608 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-39e4dc1f-ad0e-4c6c-88a0-0661e8cec8f7 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] 10.222.0.79 "GET /compute/v2.1/servers/96b38440-c5bd-4838-bd1b-46312012607e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047134 Jan 28 02:09:46.106177 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 299/634] 10.222.0.79 () {58 vars in 1301 bytes} [Fri Jan 28 02:09:46 2022] GET /compute/v2.1/servers/96b38440-c5bd-4838-bd1b-46312012607e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 02:09:46.136381 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-50a18d92-e872-4776-9378-b51cf1a8a171 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:46.145502 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-50a18d92-e872-4776-9378-b51cf1a8a171 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:46.147053 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-50a18d92-e872-4776-9378-b51cf1a8a171 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:46.148238 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-50a18d92-e872-4776-9378-b51cf1a8a171 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84" status: 200 len: 1808 microversion: 2.20 time: 0.176318 Jan 28 02:09:46.148793 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 336/635] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:09:45 2022] GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84 => generated 1808 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:09:47.064432 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-531d6439-09ae-4766-8b7c-7fe3291e2ea5 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:47.065091 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-531d6439-09ae-4766-8b7c-7fe3291e2ea5 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] [instance: ec5e47ac-761b-467f-958c-516a9f8bc3e6] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:47.071252 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-531d6439-09ae-4766-8b7c-7fe3291e2ea5 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:47.071718 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-531d6439-09ae-4766-8b7c-7fe3291e2ea5 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:47.072515 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-531d6439-09ae-4766-8b7c-7fe3291e2ea5 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:47.072947 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-531d6439-09ae-4766-8b7c-7fe3291e2ea5 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:47.118228 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-12e1feb7-32c0-419e-b5fd-e6f16206ce95 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:47.119767 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-12e1feb7-32c0-419e-b5fd-e6f16206ce95 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] [instance: 96b38440-c5bd-4838-bd1b-46312012607e] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:47.127369 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-12e1feb7-32c0-419e-b5fd-e6f16206ce95 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:47.127813 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-12e1feb7-32c0-419e-b5fd-e6f16206ce95 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:47.128628 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-12e1feb7-32c0-419e-b5fd-e6f16206ce95 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:47.129059 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-12e1feb7-32c0-419e-b5fd-e6f16206ce95 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:47.159860 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-12e1feb7-32c0-419e-b5fd-e6f16206ce95 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] 10.222.0.79 "GET /compute/v2.1/servers/96b38440-c5bd-4838-bd1b-46312012607e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046029 Jan 28 02:09:47.160463 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 337/636] 10.222.0.79 () {58 vars in 1301 bytes} [Fri Jan 28 02:09:47 2022] GET /compute/v2.1/servers/96b38440-c5bd-4838-bd1b-46312012607e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 02:09:47.167469 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-4bf79e53-6c2f-4726-b6de-39aeee637fe6 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:47.168094 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-4bf79e53-6c2f-4726-b6de-39aeee637fe6 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:47.174354 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-4bf79e53-6c2f-4726-b6de-39aeee637fe6 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:47.174804 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-4bf79e53-6c2f-4726-b6de-39aeee637fe6 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:47.177229 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-4bf79e53-6c2f-4726-b6de-39aeee637fe6 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:47.177229 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-4bf79e53-6c2f-4726-b6de-39aeee637fe6 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:47.215594 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-531d6439-09ae-4766-8b7c-7fe3291e2ea5 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd7039b8f074a13b2030a2bb7aaff94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc19a0f9c33f47f1b504bebbb0b2c931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:47.223525 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-531d6439-09ae-4766-8b7c-7fe3291e2ea5 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] 10.222.0.79 "GET /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6" status: 200 len: 1521 microversion: 2.1 time: 0.163412 Jan 28 02:09:47.224236 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 300/637] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:09:47 2022] GET /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:09:47.309912 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-4bf79e53-6c2f-4726-b6de-39aeee637fe6 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:47.318154 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-4bf79e53-6c2f-4726-b6de-39aeee637fe6 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:47.319638 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-4bf79e53-6c2f-4726-b6de-39aeee637fe6 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:47.320812 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-4bf79e53-6c2f-4726-b6de-39aeee637fe6 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84" status: 200 len: 1795 microversion: 2.20 time: 0.156920 Jan 28 02:09:47.321361 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 338/638] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:09:47 2022] GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84 => generated 1795 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 02:09:48.104575 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-057ccf06-ac40-48e4-ac79-67a0eb825317 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:48.105175 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-057ccf06-ac40-48e4-ac79-67a0eb825317 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] [instance: 086c6296-168f-46fc-9ec4-8700b7c6ca9f] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:48.112259 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-057ccf06-ac40-48e4-ac79-67a0eb825317 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:48.112650 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-057ccf06-ac40-48e4-ac79-67a0eb825317 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:48.113413 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-057ccf06-ac40-48e4-ac79-67a0eb825317 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:48.113913 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-057ccf06-ac40-48e4-ac79-67a0eb825317 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:48.170979 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-2bb30e1f-05ac-4c14-96ec-f1be46dfb874 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:48.172443 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-2bb30e1f-05ac-4c14-96ec-f1be46dfb874 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] [instance: 96b38440-c5bd-4838-bd1b-46312012607e] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:48.178630 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-2bb30e1f-05ac-4c14-96ec-f1be46dfb874 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:48.179309 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-2bb30e1f-05ac-4c14-96ec-f1be46dfb874 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:48.180407 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-2bb30e1f-05ac-4c14-96ec-f1be46dfb874 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:48.181001 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-2bb30e1f-05ac-4c14-96ec-f1be46dfb874 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:48.213804 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-2bb30e1f-05ac-4c14-96ec-f1be46dfb874 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] 10.222.0.79 "GET /compute/v2.1/servers/96b38440-c5bd-4838-bd1b-46312012607e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046575 Jan 28 02:09:48.214609 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 339/639] 10.222.0.79 () {58 vars in 1301 bytes} [Fri Jan 28 02:09:48 2022] GET /compute/v2.1/servers/96b38440-c5bd-4838-bd1b-46312012607e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 02:09:48.242344 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-817cd045-155b-4f49-a8e7-0a1cfc28d8a1 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:48.243039 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-817cd045-155b-4f49-a8e7-0a1cfc28d8a1 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] [instance: ec5e47ac-761b-467f-958c-516a9f8bc3e6] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:48.248989 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-057ccf06-ac40-48e4-ac79-67a0eb825317 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14f6f890deb74eadab6b1ff4b6431036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e991e35dc5b463fbf9f08db0e72cf46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:48.251360 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-817cd045-155b-4f49-a8e7-0a1cfc28d8a1 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:48.251816 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-817cd045-155b-4f49-a8e7-0a1cfc28d8a1 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:48.252627 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-817cd045-155b-4f49-a8e7-0a1cfc28d8a1 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:48.253201 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-817cd045-155b-4f49-a8e7-0a1cfc28d8a1 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:48.258168 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-057ccf06-ac40-48e4-ac79-67a0eb825317 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] 10.222.0.79 "GET /compute/v2.1/servers/086c6296-168f-46fc-9ec4-8700b7c6ca9f" status: 200 len: 1593 microversion: 2.1 time: 0.157291 Jan 28 02:09:48.259042 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 301/640] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:09:48 2022] GET /compute/v2.1/servers/086c6296-168f-46fc-9ec4-8700b7c6ca9f => generated 1593 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:09:48.412131 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-817cd045-155b-4f49-a8e7-0a1cfc28d8a1 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd7039b8f074a13b2030a2bb7aaff94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc19a0f9c33f47f1b504bebbb0b2c931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:48.419158 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-817cd045-155b-4f49-a8e7-0a1cfc28d8a1 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] 10.222.0.79 "GET /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6" status: 200 len: 1521 microversion: 2.1 time: 0.181168 Jan 28 02:09:48.419989 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 340/641] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:09:48 2022] GET /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6 => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:09:49.228203 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-2f2556e2-d263-4c4a-a605-ace279a355a4 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:49.229745 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-2f2556e2-d263-4c4a-a605-ace279a355a4 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] [instance: 96b38440-c5bd-4838-bd1b-46312012607e] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:49.237636 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2f2556e2-d263-4c4a-a605-ace279a355a4 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:49.238185 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2f2556e2-d263-4c4a-a605-ace279a355a4 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:49.239042 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2f2556e2-d263-4c4a-a605-ace279a355a4 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:49.239572 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2f2556e2-d263-4c4a-a605-ace279a355a4 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:49.275463 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-2f2556e2-d263-4c4a-a605-ace279a355a4 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] 10.222.0.79 "GET /compute/v2.1/servers/96b38440-c5bd-4838-bd1b-46312012607e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049403 Jan 28 02:09:49.277887 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 302/642] 10.222.0.79 () {58 vars in 1301 bytes} [Fri Jan 28 02:09:49 2022] GET /compute/v2.1/servers/96b38440-c5bd-4838-bd1b-46312012607e/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 02:09:49.435504 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-c28ad7a6-a031-44b3-8e17-d3606be347f1 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-847287325", "imageRef": "04805ce8-b0a0-41b2-b614-bfb5b752cc5d", "flavorRef": "452", "networks": [{"uuid": "a1afa762-f2ce-40be-8faa-e9c2b4144812"}]}} {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:09:49.437319 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-e6acb468-be16-4d9d-bf9c-9d0271988c7a tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:49.438236 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-e6acb468-be16-4d9d-bf9c-9d0271988c7a tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] [instance: ec5e47ac-761b-467f-958c-516a9f8bc3e6] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:49.444185 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-e6acb468-be16-4d9d-bf9c-9d0271988c7a tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:49.444849 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-e6acb468-be16-4d9d-bf9c-9d0271988c7a tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:49.445777 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-e6acb468-be16-4d9d-bf9c-9d0271988c7a tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:49.446359 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-e6acb468-be16-4d9d-bf9c-9d0271988c7a tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:49.491129 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.network.neutron [None req-c28ad7a6-a031-44b3-8e17-d3606be347f1 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] validate_networks() for [('a1afa762-f2ce-40be-8faa-e9c2b4144812', None, None, None, None, None)] {{(pid=116374) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Jan 28 02:09:49.660764 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-e6acb468-be16-4d9d-bf9c-9d0271988c7a tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd7039b8f074a13b2030a2bb7aaff94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc19a0f9c33f47f1b504bebbb0b2c931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:49.668401 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-e6acb468-be16-4d9d-bf9c-9d0271988c7a tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] 10.222.0.79 "GET /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6" status: 200 len: 1521 microversion: 2.1 time: 0.234993 Jan 28 02:09:49.678556 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 303/643] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:09:49 2022] GET /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6 => generated 1521 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:09:49.931814 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.virt.hardware [None req-c28ad7a6-a031-44b3-8e17-d3606be347f1 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Flavor limits 0:0:0 {{(pid=116374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 02:09:49.932455 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.virt.hardware [None req-c28ad7a6-a031-44b3-8e17-d3606be347f1 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Image limits 0:0:0 {{(pid=116374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 02:09:49.933156 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.virt.hardware [None req-c28ad7a6-a031-44b3-8e17-d3606be347f1 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Flavor pref 0:0:0 {{(pid=116374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 02:09:49.933557 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.virt.hardware [None req-c28ad7a6-a031-44b3-8e17-d3606be347f1 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Image pref 0:0:0 {{(pid=116374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 02:09:49.933962 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.virt.hardware [None req-c28ad7a6-a031-44b3-8e17-d3606be347f1 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 02:09:49.944417 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-c28ad7a6-a031-44b3-8e17-d3606be347f1 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:49.944859 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-c28ad7a6-a031-44b3-8e17-d3606be347f1 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:49.945655 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-c28ad7a6-a031-44b3-8e17-d3606be347f1 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:49.946384 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-c28ad7a6-a031-44b3-8e17-d3606be347f1 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:49.963113 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.quota [None req-c28ad7a6-a031-44b3-8e17-d3606be347f1 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Getting quotas for project 2b66ddee4c864aae90b738695dffbeb9. Resources: {'ram', 'cores', 'instances'} {{(pid=116374) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 02:09:49.967243 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.quota [None req-c28ad7a6-a031-44b3-8e17-d3606be347f1 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Getting quotas for user b019715a14074e059730965913694e52 and project 2b66ddee4c864aae90b738695dffbeb9. Resources: {'ram', 'cores', 'instances'} {{(pid=116374) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 02:09:49.980488 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-c28ad7a6-a031-44b3-8e17-d3606be347f1 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Going to run 1 instances... {{(pid=116374) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 02:09:49.982855 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-c28ad7a6-a031-44b3-8e17-d3606be347f1 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] [instance: 9f152f23-7594-4edf-b4f9-55a5e612e3b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='04805ce8-b0a0-41b2-b614-bfb5b752cc5d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116374) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 02:09:50.119186 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-c28ad7a6-a031-44b3-8e17-d3606be347f1 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.688270 Jan 28 02:09:50.129393 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 341/644] 10.222.0.79 () {60 vars in 1146 bytes} [Fri Jan 28 02:09:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 690 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 28 02:09:50.138829 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-7ce220b9-60c3-41c7-9175-5017e74504c4 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:50.139632 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-7ce220b9-60c3-41c7-9175-5017e74504c4 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] [instance: 9f152f23-7594-4edf-b4f9-55a5e612e3b2] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:50.201495 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-7ce220b9-60c3-41c7-9175-5017e74504c4 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b019715a14074e059730965913694e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b66ddee4c864aae90b738695dffbeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:50.209080 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-7ce220b9-60c3-41c7-9175-5017e74504c4 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] 10.222.0.79 "GET /compute/v2.1/servers/9f152f23-7594-4edf-b4f9-55a5e612e3b2" status: 200 len: 1217 microversion: 2.1 time: 0.074023 Jan 28 02:09:50.219271 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 304/645] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:09:50 2022] GET /compute/v2.1/servers/9f152f23-7594-4edf-b4f9-55a5e612e3b2 => generated 1217 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:09:50.685287 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-6af1e293-cc10-4502-847e-7ac8452dc1e9 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:50.685910 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-6af1e293-cc10-4502-847e-7ac8452dc1e9 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] [instance: ec5e47ac-761b-467f-958c-516a9f8bc3e6] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:50.692856 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-6af1e293-cc10-4502-847e-7ac8452dc1e9 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:50.693276 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-6af1e293-cc10-4502-847e-7ac8452dc1e9 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:50.694224 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-6af1e293-cc10-4502-847e-7ac8452dc1e9 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:50.694826 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-6af1e293-cc10-4502-847e-7ac8452dc1e9 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:50.817913 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [req-73eb2c07-3f13-45fc-a265-9d98dcc1e6b2 req-4721c4bf-62b6-44d3-86b4-3958fdd327e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "086c6296-168f-46fc-9ec4-8700b7c6ca9f", "tag": "deb20626-b237-4650-a93b-12a633f6daa5"}]} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:09:50.819733 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:09:50.819733 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: warnings.warn(msg) Jan 28 02:09:50.827540 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-73eb2c07-3f13-45fc-a265-9d98dcc1e6b2 req-4721c4bf-62b6-44d3-86b4-3958fdd327e1 service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:50.832156 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-73eb2c07-3f13-45fc-a265-9d98dcc1e6b2 req-4721c4bf-62b6-44d3-86b4-3958fdd327e1 service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:50.845364 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.compute.server_external_events [req-73eb2c07-3f13-45fc-a265-9d98dcc1e6b2 req-4721c4bf-62b6-44d3-86b4-3958fdd327e1 service nova] Creating event network-changed:deb20626-b237-4650-a93b-12a633f6daa5 for instance 086c6296-168f-46fc-9ec4-8700b7c6ca9f on hv-cinder-82497 Jan 28 02:09:50.855250 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [req-73eb2c07-3f13-45fc-a265-9d98dcc1e6b2 req-4721c4bf-62b6-44d3-86b4-3958fdd327e1 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035863 Jan 28 02:09:50.861988 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 305/646] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Jan 28 02:09:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 02:09:50.993961 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-6af1e293-cc10-4502-847e-7ac8452dc1e9 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd7039b8f074a13b2030a2bb7aaff94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc19a0f9c33f47f1b504bebbb0b2c931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:50.994126 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [req-8c9c98db-de46-41c2-89bb-2e89dfc23c9d req-dc80e519-a488-425a-8a88-e8b605c87274 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec5e47ac-761b-467f-958c-516a9f8bc3e6", "name": "network-vif-deleted", "tag": "333b77f2-3cf1-4c8f-94ce-5901a7eb748d"}]} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:09:50.995559 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:09:50.995559 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: warnings.warn(msg) Jan 28 02:09:51.006877 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-8c9c98db-de46-41c2-89bb-2e89dfc23c9d req-dc80e519-a488-425a-8a88-e8b605c87274 service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:51.007471 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-6af1e293-cc10-4502-847e-7ac8452dc1e9 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] 10.222.0.79 "GET /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6" status: 200 len: 1521 microversion: 2.1 time: 0.325560 Jan 28 02:09:51.008310 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-8c9c98db-de46-41c2-89bb-2e89dfc23c9d req-dc80e519-a488-425a-8a88-e8b605c87274 service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:51.019438 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 342/647] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:09:50 2022] GET /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6 => generated 1521 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:09:51.026271 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.compute.server_external_events [req-8c9c98db-de46-41c2-89bb-2e89dfc23c9d req-dc80e519-a488-425a-8a88-e8b605c87274 service nova] Creating event network-vif-deleted:333b77f2-3cf1-4c8f-94ce-5901a7eb748d for instance ec5e47ac-761b-467f-958c-516a9f8bc3e6 on hv-cinder-82497 Jan 28 02:09:51.033502 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [req-8c9c98db-de46-41c2-89bb-2e89dfc23c9d req-dc80e519-a488-425a-8a88-e8b605c87274 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044027 Jan 28 02:09:51.034113 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 306/648] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Jan 28 02:09:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:09:51.226378 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-e36d8252-2fd1-49d2-8c63-3559a27df2e4 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:51.227610 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-e36d8252-2fd1-49d2-8c63-3559a27df2e4 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] [instance: 9f152f23-7594-4edf-b4f9-55a5e612e3b2] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:51.234638 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-e36d8252-2fd1-49d2-8c63-3559a27df2e4 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:51.236109 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-e36d8252-2fd1-49d2-8c63-3559a27df2e4 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:51.237262 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-e36d8252-2fd1-49d2-8c63-3559a27df2e4 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:51.237822 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-e36d8252-2fd1-49d2-8c63-3559a27df2e4 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:51.361955 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-e36d8252-2fd1-49d2-8c63-3559a27df2e4 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b019715a14074e059730965913694e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b66ddee4c864aae90b738695dffbeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:51.370013 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-e36d8252-2fd1-49d2-8c63-3559a27df2e4 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] 10.222.0.79 "GET /compute/v2.1/servers/9f152f23-7594-4edf-b4f9-55a5e612e3b2" status: 200 len: 1221 microversion: 2.1 time: 0.147840 Jan 28 02:09:51.370704 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 343/649] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:09:51 2022] GET /compute/v2.1/servers/9f152f23-7594-4edf-b4f9-55a5e612e3b2 => generated 1221 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:09:52.025755 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-ea451151-6672-41ad-a3c2-69ed7aea4e9f tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:52.026522 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-ea451151-6672-41ad-a3c2-69ed7aea4e9f tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] [instance: ec5e47ac-761b-467f-958c-516a9f8bc3e6] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:52.033679 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ea451151-6672-41ad-a3c2-69ed7aea4e9f tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:52.034205 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ea451151-6672-41ad-a3c2-69ed7aea4e9f tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:52.035050 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ea451151-6672-41ad-a3c2-69ed7aea4e9f tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:52.035550 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ea451151-6672-41ad-a3c2-69ed7aea4e9f tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:52.070062 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ea451151-6672-41ad-a3c2-69ed7aea4e9f tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:52.070522 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ea451151-6672-41ad-a3c2-69ed7aea4e9f tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:52.071139 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.objects.instance [None req-ea451151-6672-41ad-a3c2-69ed7aea4e9f tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lazy-loading 'fault' on Instance uuid ec5e47ac-761b-467f-958c-516a9f8bc3e6 {{(pid=116375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jan 28 02:09:52.113059 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-ea451151-6672-41ad-a3c2-69ed7aea4e9f tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fd7039b8f074a13b2030a2bb7aaff94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc19a0f9c33f47f1b504bebbb0b2c931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:52.120408 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-ea451151-6672-41ad-a3c2-69ed7aea4e9f tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] 10.222.0.79 "GET /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6" status: 200 len: 1312 microversion: 2.1 time: 0.098754 Jan 28 02:09:52.120977 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 307/650] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:09:52 2022] GET /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6 => generated 1312 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:09:52.386556 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-af429cc7-0422-4e84-ac04-6fcb3623d522 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:52.387372 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-af429cc7-0422-4e84-ac04-6fcb3623d522 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] [instance: 9f152f23-7594-4edf-b4f9-55a5e612e3b2] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:52.394072 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-af429cc7-0422-4e84-ac04-6fcb3623d522 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:52.394682 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-af429cc7-0422-4e84-ac04-6fcb3623d522 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:52.395530 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-af429cc7-0422-4e84-ac04-6fcb3623d522 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:52.396059 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-af429cc7-0422-4e84-ac04-6fcb3623d522 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:52.464018 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-af429cc7-0422-4e84-ac04-6fcb3623d522 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b019715a14074e059730965913694e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b66ddee4c864aae90b738695dffbeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:52.473054 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-af429cc7-0422-4e84-ac04-6fcb3623d522 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] 10.222.0.79 "GET /compute/v2.1/servers/9f152f23-7594-4edf-b4f9-55a5e612e3b2" status: 200 len: 1213 microversion: 2.1 time: 0.090154 Jan 28 02:09:52.473968 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 344/651] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:09:52 2022] GET /compute/v2.1/servers/9f152f23-7594-4edf-b4f9-55a5e612e3b2 => generated 1213 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:09:53.142042 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-874d581f-1b02-4779-80c5-e18e24bd7ba4 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:53.142711 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-874d581f-1b02-4779-80c5-e18e24bd7ba4 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] [instance: ec5e47ac-761b-467f-958c-516a9f8bc3e6] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:53.151329 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-874d581f-1b02-4779-80c5-e18e24bd7ba4 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:53.151784 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-874d581f-1b02-4779-80c5-e18e24bd7ba4 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:53.152597 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-874d581f-1b02-4779-80c5-e18e24bd7ba4 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:53.153032 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-874d581f-1b02-4779-80c5-e18e24bd7ba4 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:53.167564 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.wsgi [None req-874d581f-1b02-4779-80c5-e18e24bd7ba4 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] HTTP exception thrown: Instance ec5e47ac-761b-467f-958c-516a9f8bc3e6 could not be found. Jan 28 02:09:53.168323 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-874d581f-1b02-4779-80c5-e18e24bd7ba4 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] Returning 404 to user: Instance ec5e47ac-761b-467f-958c-516a9f8bc3e6 could not be found. {{(pid=116375) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 02:09:53.169155 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-874d581f-1b02-4779-80c5-e18e24bd7ba4 tempest-ServerRescueNegativeTestJSON-1053475083 tempest-ServerRescueNegativeTestJSON-1053475083-project] 10.222.0.79 "GET /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6" status: 404 len: 111 microversion: 2.1 time: 0.033643 Jan 28 02:09:53.169755 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 308/652] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:09:53 2022] GET /compute/v2.1/servers/ec5e47ac-761b-467f-958c-516a9f8bc3e6 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 02:09:53.492644 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-b31bed29-9671-422f-93e1-7e2fd8f5186c tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:53.494036 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-b31bed29-9671-422f-93e1-7e2fd8f5186c tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] [instance: 9f152f23-7594-4edf-b4f9-55a5e612e3b2] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:53.502620 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-b31bed29-9671-422f-93e1-7e2fd8f5186c tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:53.503576 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-b31bed29-9671-422f-93e1-7e2fd8f5186c tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:53.504710 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-b31bed29-9671-422f-93e1-7e2fd8f5186c tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:53.505374 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-b31bed29-9671-422f-93e1-7e2fd8f5186c tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:53.724605 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-45d18722-1310-40f6-912d-91c1e68fb5cd tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-702916367"}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:09:53.725596 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-45d18722-1310-40f6-912d-91c1e68fb5cd tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] [instance: 086c6296-168f-46fc-9ec4-8700b7c6ca9f] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:53.731990 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-45d18722-1310-40f6-912d-91c1e68fb5cd tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:53.732539 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-45d18722-1310-40f6-912d-91c1e68fb5cd tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:53.733468 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-45d18722-1310-40f6-912d-91c1e68fb5cd tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:53.733995 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-45d18722-1310-40f6-912d-91c1e68fb5cd tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:53.866939 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-b31bed29-9671-422f-93e1-7e2fd8f5186c tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b019715a14074e059730965913694e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b66ddee4c864aae90b738695dffbeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:53.874338 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-b31bed29-9671-422f-93e1-7e2fd8f5186c tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] 10.222.0.79 "GET /compute/v2.1/servers/9f152f23-7594-4edf-b4f9-55a5e612e3b2" status: 200 len: 1287 microversion: 2.1 time: 0.387964 Jan 28 02:09:53.875739 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 345/653] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:09:53 2022] GET /compute/v2.1/servers/9f152f23-7594-4edf-b4f9-55a5e612e3b2 => generated 1287 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:09:54.042765 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.network.security_group_api [None req-45d18722-1310-40f6-912d-91c1e68fb5cd tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Adding security group 843a7a38-8512-47d0-ac6e-f19ff26f1d0c to port deb20626-b237-4650-a93b-12a633f6daa5 Jan 28 02:09:54.892708 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-e3ac6ef7-a778-45b8-b378-ef11282080fa tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:54.893314 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-e3ac6ef7-a778-45b8-b378-ef11282080fa tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] [instance: 9f152f23-7594-4edf-b4f9-55a5e612e3b2] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:54.899084 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-e3ac6ef7-a778-45b8-b378-ef11282080fa tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:54.899582 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-e3ac6ef7-a778-45b8-b378-ef11282080fa tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:54.900336 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-e3ac6ef7-a778-45b8-b378-ef11282080fa tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:54.900797 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-e3ac6ef7-a778-45b8-b378-ef11282080fa tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:55.053866 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-45d18722-1310-40f6-912d-91c1e68fb5cd tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] 10.222.0.79 "POST /compute/v2.1/servers/086c6296-168f-46fc-9ec4-8700b7c6ca9f/action" status: 202 len: 0 microversion: 2.1 time: 1.333044 Jan 28 02:09:55.055026 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 309/654] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Jan 28 02:09:53 2022] POST /compute/v2.1/servers/086c6296-168f-46fc-9ec4-8700b7c6ca9f/action => generated 0 bytes in 1335 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:09:55.065141 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-df0b9658-f0b1-4b33-86f0-8378a3f256a5 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:55.069379 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-df0b9658-f0b1-4b33-86f0-8378a3f256a5 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] [instance: 086c6296-168f-46fc-9ec4-8700b7c6ca9f] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:55.075677 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-df0b9658-f0b1-4b33-86f0-8378a3f256a5 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:55.076087 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-df0b9658-f0b1-4b33-86f0-8378a3f256a5 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:55.076878 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-df0b9658-f0b1-4b33-86f0-8378a3f256a5 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:55.077308 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-df0b9658-f0b1-4b33-86f0-8378a3f256a5 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:55.357725 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-e3ac6ef7-a778-45b8-b378-ef11282080fa tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b019715a14074e059730965913694e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b66ddee4c864aae90b738695dffbeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:55.362540 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-e3ac6ef7-a778-45b8-b378-ef11282080fa tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] 10.222.0.79 "GET /compute/v2.1/servers/9f152f23-7594-4edf-b4f9-55a5e612e3b2" status: 200 len: 1317 microversion: 2.1 time: 0.474222 Jan 28 02:09:55.363585 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 346/655] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:09:54 2022] GET /compute/v2.1/servers/9f152f23-7594-4edf-b4f9-55a5e612e3b2 => generated 1317 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:09:55.368289 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [req-a1dd657d-bc34-4d6c-af78-2492916aa8d0 req-c0130ee6-c044-4822-9276-5edb1a52262c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "086c6296-168f-46fc-9ec4-8700b7c6ca9f", "tag": "deb20626-b237-4650-a93b-12a633f6daa5"}]} {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:09:55.370139 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:09:55.370139 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: warnings.warn(msg) Jan 28 02:09:55.378378 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [req-a1dd657d-bc34-4d6c-af78-2492916aa8d0 req-c0130ee6-c044-4822-9276-5edb1a52262c service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:55.378958 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [req-a1dd657d-bc34-4d6c-af78-2492916aa8d0 req-c0130ee6-c044-4822-9276-5edb1a52262c service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:55.402259 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.compute.server_external_events [req-a1dd657d-bc34-4d6c-af78-2492916aa8d0 req-c0130ee6-c044-4822-9276-5edb1a52262c service nova] Creating event network-changed:deb20626-b237-4650-a93b-12a633f6daa5 for instance 086c6296-168f-46fc-9ec4-8700b7c6ca9f on hv-cinder-82497 Jan 28 02:09:55.416350 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [req-a1dd657d-bc34-4d6c-af78-2492916aa8d0 req-c0130ee6-c044-4822-9276-5edb1a52262c service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050679 Jan 28 02:09:55.417930 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 347/656] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Jan 28 02:09:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:09:55.478374 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-df0b9658-f0b1-4b33-86f0-8378a3f256a5 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14f6f890deb74eadab6b1ff4b6431036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e991e35dc5b463fbf9f08db0e72cf46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:55.488013 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-df0b9658-f0b1-4b33-86f0-8378a3f256a5 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] 10.222.0.79 "GET /compute/v2.1/servers/086c6296-168f-46fc-9ec4-8700b7c6ca9f" status: 200 len: 1758 microversion: 2.1 time: 0.428310 Jan 28 02:09:55.488699 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 310/657] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:09:55 2022] GET /compute/v2.1/servers/086c6296-168f-46fc-9ec4-8700b7c6ca9f => generated 1758 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:09:56.381012 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-81137725-06d8-4725-b09e-458bb2b802fc tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:56.381963 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-81137725-06d8-4725-b09e-458bb2b802fc tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] [instance: 9f152f23-7594-4edf-b4f9-55a5e612e3b2] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:56.389376 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-81137725-06d8-4725-b09e-458bb2b802fc tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:56.389909 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-81137725-06d8-4725-b09e-458bb2b802fc tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:56.390912 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-81137725-06d8-4725-b09e-458bb2b802fc tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:56.391469 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-81137725-06d8-4725-b09e-458bb2b802fc tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:56.817651 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-81137725-06d8-4725-b09e-458bb2b802fc tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b019715a14074e059730965913694e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b66ddee4c864aae90b738695dffbeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:56.824838 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-81137725-06d8-4725-b09e-458bb2b802fc tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] 10.222.0.79 "GET /compute/v2.1/servers/9f152f23-7594-4edf-b4f9-55a5e612e3b2" status: 200 len: 1317 microversion: 2.1 time: 0.447836 Jan 28 02:09:56.825779 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 348/658] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:09:56 2022] GET /compute/v2.1/servers/9f152f23-7594-4edf-b4f9-55a5e612e3b2 => generated 1317 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:09:57.603988 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [req-709d0476-8100-4633-9b27-54a8d6e5b680 req-133318e0-e15d-434b-a53a-65a42815a2fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f152f23-7594-4edf-b4f9-55a5e612e3b2", "tag": "c5c39784-9c84-4033-af10-4d23893a7023"}]} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:09:57.607652 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:09:57.607652 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: warnings.warn(msg) Jan 28 02:09:57.617418 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-709d0476-8100-4633-9b27-54a8d6e5b680 req-133318e0-e15d-434b-a53a-65a42815a2fc service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:57.622770 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-709d0476-8100-4633-9b27-54a8d6e5b680 req-133318e0-e15d-434b-a53a-65a42815a2fc service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:57.639676 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.compute.server_external_events [req-709d0476-8100-4633-9b27-54a8d6e5b680 req-133318e0-e15d-434b-a53a-65a42815a2fc service nova] Creating event network-changed:c5c39784-9c84-4033-af10-4d23893a7023 for instance 9f152f23-7594-4edf-b4f9-55a5e612e3b2 on hv-cinder-82497 Jan 28 02:09:57.645160 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [req-709d0476-8100-4633-9b27-54a8d6e5b680 req-133318e0-e15d-434b-a53a-65a42815a2fc service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046738 Jan 28 02:09:57.646005 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 311/659] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Jan 28 02:09:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:09:57.841396 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-32ecc9ac-99bd-40c5-b62a-a2f39fe1baab tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:57.842043 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-32ecc9ac-99bd-40c5-b62a-a2f39fe1baab tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] [instance: 9f152f23-7594-4edf-b4f9-55a5e612e3b2] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:57.848931 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-32ecc9ac-99bd-40c5-b62a-a2f39fe1baab tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:57.849256 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-32ecc9ac-99bd-40c5-b62a-a2f39fe1baab tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:57.850029 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-32ecc9ac-99bd-40c5-b62a-a2f39fe1baab tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:57.850603 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-32ecc9ac-99bd-40c5-b62a-a2f39fe1baab tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:58.157333 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-32ecc9ac-99bd-40c5-b62a-a2f39fe1baab tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b019715a14074e059730965913694e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b66ddee4c864aae90b738695dffbeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:58.168018 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-32ecc9ac-99bd-40c5-b62a-a2f39fe1baab tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] 10.222.0.79 "GET /compute/v2.1/servers/9f152f23-7594-4edf-b4f9-55a5e612e3b2" status: 200 len: 1317 microversion: 2.1 time: 0.328892 Jan 28 02:09:58.168018 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 349/660] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:09:57 2022] GET /compute/v2.1/servers/9f152f23-7594-4edf-b4f9-55a5e612e3b2 => generated 1317 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:09:59.183728 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-168b0018-7288-4eec-8981-18533e516935 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:09:59.185117 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-168b0018-7288-4eec-8981-18533e516935 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] [instance: 9f152f23-7594-4edf-b4f9-55a5e612e3b2] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:09:59.191710 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-168b0018-7288-4eec-8981-18533e516935 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:59.192194 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-168b0018-7288-4eec-8981-18533e516935 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:59.193224 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-168b0018-7288-4eec-8981-18533e516935 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:09:59.193768 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-168b0018-7288-4eec-8981-18533e516935 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:09:59.354476 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-168b0018-7288-4eec-8981-18533e516935 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b019715a14074e059730965913694e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b66ddee4c864aae90b738695dffbeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:09:59.361882 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-168b0018-7288-4eec-8981-18533e516935 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] 10.222.0.79 "GET /compute/v2.1/servers/9f152f23-7594-4edf-b4f9-55a5e612e3b2" status: 200 len: 1317 microversion: 2.1 time: 0.182786 Jan 28 02:09:59.362448 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 312/661] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:09:59 2022] GET /compute/v2.1/servers/9f152f23-7594-4edf-b4f9-55a5e612e3b2 => generated 1317 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:10:00.378701 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-8c981202-e1c3-4886-b837-b6d179a46e7d tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:10:00.379246 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-8c981202-e1c3-4886-b837-b6d179a46e7d tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] [instance: 9f152f23-7594-4edf-b4f9-55a5e612e3b2] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:10:00.385014 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-8c981202-e1c3-4886-b837-b6d179a46e7d tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:00.385457 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-8c981202-e1c3-4886-b837-b6d179a46e7d tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:00.386284 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-8c981202-e1c3-4886-b837-b6d179a46e7d tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:00.386629 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-8c981202-e1c3-4886-b837-b6d179a46e7d tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:00.515868 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-8c981202-e1c3-4886-b837-b6d179a46e7d tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b019715a14074e059730965913694e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b66ddee4c864aae90b738695dffbeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:10:00.523426 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-8c981202-e1c3-4886-b837-b6d179a46e7d tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] 10.222.0.79 "GET /compute/v2.1/servers/9f152f23-7594-4edf-b4f9-55a5e612e3b2" status: 200 len: 1317 microversion: 2.1 time: 0.148847 Jan 28 02:10:00.526968 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 350/662] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:10:00 2022] GET /compute/v2.1/servers/9f152f23-7594-4edf-b4f9-55a5e612e3b2 => generated 1317 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:10:00.755054 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-f822bc30-9f1c-494b-94c8-dd2e50bb4fa7 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1656003993", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-740833808", "security_groups": [{"name": "tempest-secgroup-smoke-964688091"}], "networks": [{"uuid": "ace90374-1bab-41ed-86ab-f24b42895456"}], "block_device_mapping_v2": [{"uuid": "66e129fb-2f25-4acd-b527-2825dae043c7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:10:00.861910 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.network.neutron [None req-f822bc30-9f1c-494b-94c8-dd2e50bb4fa7 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] validate_networks() for [('ace90374-1bab-41ed-86ab-f24b42895456', None, None, None, None, None)] {{(pid=116375) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Jan 28 02:10:01.240300 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.virt.hardware [None req-f822bc30-9f1c-494b-94c8-dd2e50bb4fa7 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Flavor limits 0:0:0 {{(pid=116375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 02:10:01.240733 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.virt.hardware [None req-f822bc30-9f1c-494b-94c8-dd2e50bb4fa7 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Image limits 0:0:0 {{(pid=116375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 02:10:01.241206 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.virt.hardware [None req-f822bc30-9f1c-494b-94c8-dd2e50bb4fa7 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Flavor pref 0:0:0 {{(pid=116375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 02:10:01.241611 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.virt.hardware [None req-f822bc30-9f1c-494b-94c8-dd2e50bb4fa7 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Image pref 0:0:0 {{(pid=116375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 02:10:01.242255 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.virt.hardware [None req-f822bc30-9f1c-494b-94c8-dd2e50bb4fa7 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 02:10:01.251144 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f822bc30-9f1c-494b-94c8-dd2e50bb4fa7 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:01.251596 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f822bc30-9f1c-494b-94c8-dd2e50bb4fa7 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:01.252584 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f822bc30-9f1c-494b-94c8-dd2e50bb4fa7 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:01.253026 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f822bc30-9f1c-494b-94c8-dd2e50bb4fa7 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:01.270349 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.quota [None req-f822bc30-9f1c-494b-94c8-dd2e50bb4fa7 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Getting quotas for project a55dde8892fa47bd9941bb1ce9aa3673. Resources: {'ram', 'cores', 'instances'} {{(pid=116375) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 02:10:01.274325 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.quota [None req-f822bc30-9f1c-494b-94c8-dd2e50bb4fa7 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Getting quotas for user bb5c39b83f31473696c9b249ab49d780 and project a55dde8892fa47bd9941bb1ce9aa3673. Resources: {'ram', 'cores', 'instances'} {{(pid=116375) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 02:10:01.336512 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-f822bc30-9f1c-494b-94c8-dd2e50bb4fa7 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Going to run 1 instances... {{(pid=116375) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 02:10:01.337901 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-f822bc30-9f1c-494b-94c8-dd2e50bb4fa7 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] [instance: 9b886ef6-6c08-4ed8-9d10-35c49c2c6382] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='66e129fb-2f25-4acd-b527-2825dae043c7',volume_size=None,volume_type=None)] {{(pid=116375) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 02:10:01.541523 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-e4a4a64e-8919-4ca8-a409-41996a4a0604 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:10:01.542133 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-e4a4a64e-8919-4ca8-a409-41996a4a0604 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] [instance: 9f152f23-7594-4edf-b4f9-55a5e612e3b2] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:10:01.548520 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-e4a4a64e-8919-4ca8-a409-41996a4a0604 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:01.548978 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-e4a4a64e-8919-4ca8-a409-41996a4a0604 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:01.549749 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-e4a4a64e-8919-4ca8-a409-41996a4a0604 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:01.550175 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-e4a4a64e-8919-4ca8-a409-41996a4a0604 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:01.666147 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-f822bc30-9f1c-494b-94c8-dd2e50bb4fa7 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.914695 Jan 28 02:10:01.666953 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 313/663] 10.222.0.79 () {60 vars in 1146 bytes} [Fri Jan 28 02:10:00 2022] POST /compute/v2.1/servers => generated 405 bytes in 916 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 28 02:10:01.677995 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-e4a4a64e-8919-4ca8-a409-41996a4a0604 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b019715a14074e059730965913694e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b66ddee4c864aae90b738695dffbeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:10:01.685901 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-e4a4a64e-8919-4ca8-a409-41996a4a0604 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] 10.222.0.79 "GET /compute/v2.1/servers/9f152f23-7594-4edf-b4f9-55a5e612e3b2" status: 200 len: 1317 microversion: 2.1 time: 0.148055 Jan 28 02:10:01.700545 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 351/664] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:10:01 2022] GET /compute/v2.1/servers/9f152f23-7594-4edf-b4f9-55a5e612e3b2 => generated 1317 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:10:01.701833 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-3ef31313-446b-444b-acc3-7d3cceb83653 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:10:01.701833 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-3ef31313-446b-444b-acc3-7d3cceb83653 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] [instance: 9b886ef6-6c08-4ed8-9d10-35c49c2c6382] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:10:01.748820 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-3ef31313-446b-444b-acc3-7d3cceb83653 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5c39b83f31473696c9b249ab49d780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55dde8892fa47bd9941bb1ce9aa3673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:10:01.756932 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-3ef31313-446b-444b-acc3-7d3cceb83653 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] 10.222.0.79 "GET /compute/v2.1/servers/9b886ef6-6c08-4ed8-9d10-35c49c2c6382" status: 200 len: 1088 microversion: 2.1 time: 0.083383 Jan 28 02:10:01.757526 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 314/665] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:10:01 2022] GET /compute/v2.1/servers/9b886ef6-6c08-4ed8-9d10-35c49c2c6382 => generated 1088 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:10:01.926618 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-35f2cbae-ffe9-43ad-9853-a641ca15e59d tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:10:01.927093 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-35f2cbae-ffe9-43ad-9853-a641ca15e59d tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: d5f49055-da38-486c-9f10-1658c64d46f5] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:10:01.932862 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-35f2cbae-ffe9-43ad-9853-a641ca15e59d tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:01.933301 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-35f2cbae-ffe9-43ad-9853-a641ca15e59d tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:01.934178 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-35f2cbae-ffe9-43ad-9853-a641ca15e59d tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:01.934608 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-35f2cbae-ffe9-43ad-9853-a641ca15e59d tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:02.020064 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.objects.instance [None req-35f2cbae-ffe9-43ad-9853-a641ca15e59d tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lazy-loading 'services' on Instance uuid d5f49055-da38-486c-9f10-1658c64d46f5 {{(pid=116374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jan 28 02:10:02.224419 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-35f2cbae-ffe9-43ad-9853-a641ca15e59d tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "DELETE /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5/os-volume_attachments/856a7cc8-e8f8-4bd9-8ead-ecca47c1f9b5" status: 202 len: 0 microversion: 2.1 time: 0.301204 Jan 28 02:10:02.225012 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 352/666] 10.222.0.79 () {58 vars in 1415 bytes} [Fri Jan 28 02:10:01 2022] DELETE /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5/os-volume_attachments/856a7cc8-e8f8-4bd9-8ead-ecca47c1f9b5 => generated 0 bytes in 303 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 28 02:10:02.706887 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-674e31a8-6b09-48e3-9886-54744d338356 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:10:02.707582 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-674e31a8-6b09-48e3-9886-54744d338356 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] [instance: 9f152f23-7594-4edf-b4f9-55a5e612e3b2] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:10:02.713818 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-674e31a8-6b09-48e3-9886-54744d338356 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:02.714443 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-674e31a8-6b09-48e3-9886-54744d338356 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:02.715273 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-674e31a8-6b09-48e3-9886-54744d338356 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:02.715764 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-674e31a8-6b09-48e3-9886-54744d338356 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:02.775105 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-fb64390d-6eda-491b-92e9-f5fe5f15a42e tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:10:02.775865 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-fb64390d-6eda-491b-92e9-f5fe5f15a42e tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] [instance: 9b886ef6-6c08-4ed8-9d10-35c49c2c6382] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:10:02.783826 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-fb64390d-6eda-491b-92e9-f5fe5f15a42e tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:02.784545 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-fb64390d-6eda-491b-92e9-f5fe5f15a42e tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:02.785508 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-fb64390d-6eda-491b-92e9-f5fe5f15a42e tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:02.785944 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-fb64390d-6eda-491b-92e9-f5fe5f15a42e tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:02.853736 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-fb64390d-6eda-491b-92e9-f5fe5f15a42e tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5c39b83f31473696c9b249ab49d780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55dde8892fa47bd9941bb1ce9aa3673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:10:02.863774 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-fb64390d-6eda-491b-92e9-f5fe5f15a42e tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] 10.222.0.79 "GET /compute/v2.1/servers/9b886ef6-6c08-4ed8-9d10-35c49c2c6382" status: 200 len: 1138 microversion: 2.1 time: 0.092664 Jan 28 02:10:02.870740 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 353/667] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:10:02 2022] GET /compute/v2.1/servers/9b886ef6-6c08-4ed8-9d10-35c49c2c6382 => generated 1138 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:10:02.880191 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-674e31a8-6b09-48e3-9886-54744d338356 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b019715a14074e059730965913694e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b66ddee4c864aae90b738695dffbeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:10:02.890781 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-674e31a8-6b09-48e3-9886-54744d338356 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] 10.222.0.79 "GET /compute/v2.1/servers/9f152f23-7594-4edf-b4f9-55a5e612e3b2" status: 200 len: 1317 microversion: 2.1 time: 0.188418 Jan 28 02:10:02.891373 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 315/668] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:10:02 2022] GET /compute/v2.1/servers/9f152f23-7594-4edf-b4f9-55a5e612e3b2 => generated 1317 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:10:03.883148 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-ffd5c902-56b1-46c4-8631-73888df25072 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:10:03.884025 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-ffd5c902-56b1-46c4-8631-73888df25072 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] [instance: 9b886ef6-6c08-4ed8-9d10-35c49c2c6382] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:10:03.890016 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-ffd5c902-56b1-46c4-8631-73888df25072 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:03.890521 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-ffd5c902-56b1-46c4-8631-73888df25072 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:03.891593 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-ffd5c902-56b1-46c4-8631-73888df25072 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:03.892116 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-ffd5c902-56b1-46c4-8631-73888df25072 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:03.908956 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-c3a921a9-bb23-432b-b98e-c3ceccd5bce8 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:10:03.909589 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-c3a921a9-bb23-432b-b98e-c3ceccd5bce8 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] [instance: 9f152f23-7594-4edf-b4f9-55a5e612e3b2] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:10:03.916508 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c3a921a9-bb23-432b-b98e-c3ceccd5bce8 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:03.916949 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c3a921a9-bb23-432b-b98e-c3ceccd5bce8 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:03.917779 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c3a921a9-bb23-432b-b98e-c3ceccd5bce8 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:03.918272 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c3a921a9-bb23-432b-b98e-c3ceccd5bce8 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:03.958049 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-ffd5c902-56b1-46c4-8631-73888df25072 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5c39b83f31473696c9b249ab49d780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55dde8892fa47bd9941bb1ce9aa3673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:10:03.965746 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-ffd5c902-56b1-46c4-8631-73888df25072 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] 10.222.0.79 "GET /compute/v2.1/servers/9b886ef6-6c08-4ed8-9d10-35c49c2c6382" status: 200 len: 1186 microversion: 2.1 time: 0.086972 Jan 28 02:10:03.966309 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 354/669] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:10:03 2022] GET /compute/v2.1/servers/9b886ef6-6c08-4ed8-9d10-35c49c2c6382 => generated 1186 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:10:04.099809 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-c3a921a9-bb23-432b-b98e-c3ceccd5bce8 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b019715a14074e059730965913694e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b66ddee4c864aae90b738695dffbeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:10:04.107321 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-c3a921a9-bb23-432b-b98e-c3ceccd5bce8 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] 10.222.0.79 "GET /compute/v2.1/servers/9f152f23-7594-4edf-b4f9-55a5e612e3b2" status: 200 len: 1317 microversion: 2.1 time: 0.203147 Jan 28 02:10:04.117846 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 316/670] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:10:03 2022] GET /compute/v2.1/servers/9f152f23-7594-4edf-b4f9-55a5e612e3b2 => generated 1317 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:10:04.411846 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-3627ab5d-847e-4598-921f-a96bf6117e46 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:10:04.418992 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-3627ab5d-847e-4598-921f-a96bf6117e46 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:04.418992 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-3627ab5d-847e-4598-921f-a96bf6117e46 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:04.442245 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-3627ab5d-847e-4598-921f-a96bf6117e46 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: d5f49055-da38-486c-9f10-1658c64d46f5] Going to try to stop instance {{(pid=116374) force_stop /opt/stack/nova/nova/compute/api.py:2652}} Jan 28 02:10:04.633016 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-3627ab5d-847e-4598-921f-a96bf6117e46 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "POST /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5/action" status: 202 len: 0 microversion: 2.1 time: 0.224733 Jan 28 02:10:04.633697 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 355/671] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Jan 28 02:10:04 2022] POST /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5/action => generated 0 bytes in 226 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:10:04.642123 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-3f68eb21-fab2-4ab1-a900-90b8063627c5 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:10:04.643097 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-3f68eb21-fab2-4ab1-a900-90b8063627c5 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: d5f49055-da38-486c-9f10-1658c64d46f5] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:10:04.649587 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-3f68eb21-fab2-4ab1-a900-90b8063627c5 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:04.650359 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-3f68eb21-fab2-4ab1-a900-90b8063627c5 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:04.651332 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-3f68eb21-fab2-4ab1-a900-90b8063627c5 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:04.652007 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-3f68eb21-fab2-4ab1-a900-90b8063627c5 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:04.833260 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-3f68eb21-fab2-4ab1-a900-90b8063627c5 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acab2a0c4a0e48909317791a3de85b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abe012ba65845329098e0e06c54b9c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:10:04.841235 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-3f68eb21-fab2-4ab1-a900-90b8063627c5 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "GET /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5" status: 200 len: 1677 microversion: 2.1 time: 0.203367 Jan 28 02:10:04.841814 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 317/672] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:10:04 2022] GET /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5 => generated 1677 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:10:04.857584 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [req-f1d590c5-171d-489e-8840-53e838755dc6 req-0c2d1139-e0a5-4255-89b9-2c27ae8678aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f152f23-7594-4edf-b4f9-55a5e612e3b2", "name": "network-vif-plugged", "status": "completed", "tag": "c5c39784-9c84-4033-af10-4d23893a7023"}]} {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:10:04.860149 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:10:04.860149 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: warnings.warn(msg) Jan 28 02:10:04.866937 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [req-f1d590c5-171d-489e-8840-53e838755dc6 req-0c2d1139-e0a5-4255-89b9-2c27ae8678aa service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:04.867374 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [req-f1d590c5-171d-489e-8840-53e838755dc6 req-0c2d1139-e0a5-4255-89b9-2c27ae8678aa service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:04.879436 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.compute.server_external_events [req-f1d590c5-171d-489e-8840-53e838755dc6 req-0c2d1139-e0a5-4255-89b9-2c27ae8678aa service nova] Creating event network-vif-plugged:c5c39784-9c84-4033-af10-4d23893a7023 for instance 9f152f23-7594-4edf-b4f9-55a5e612e3b2 on hv-cinder-82497 Jan 28 02:10:04.884926 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [req-f1d590c5-171d-489e-8840-53e838755dc6 req-0c2d1139-e0a5-4255-89b9-2c27ae8678aa service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030740 Jan 28 02:10:04.885514 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 356/673] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Jan 28 02:10:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:10:04.987192 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-ca47a07d-638c-44f0-95ca-3f00d060a292 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:10:04.987717 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-ca47a07d-638c-44f0-95ca-3f00d060a292 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] [instance: 9b886ef6-6c08-4ed8-9d10-35c49c2c6382] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:10:05.013745 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ca47a07d-638c-44f0-95ca-3f00d060a292 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:05.019846 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ca47a07d-638c-44f0-95ca-3f00d060a292 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:05.019846 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ca47a07d-638c-44f0-95ca-3f00d060a292 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:05.019846 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ca47a07d-638c-44f0-95ca-3f00d060a292 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:05.126823 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-ca06e368-c9e8-48c9-abeb-cbcb4508f317 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:10:05.127507 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-ca06e368-c9e8-48c9-abeb-cbcb4508f317 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] [instance: 9f152f23-7594-4edf-b4f9-55a5e612e3b2] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:10:05.150092 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-ca06e368-c9e8-48c9-abeb-cbcb4508f317 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:05.150646 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-ca06e368-c9e8-48c9-abeb-cbcb4508f317 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:05.151627 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-ca06e368-c9e8-48c9-abeb-cbcb4508f317 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:05.152131 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-ca06e368-c9e8-48c9-abeb-cbcb4508f317 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:05.251440 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-ca47a07d-638c-44f0-95ca-3f00d060a292 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5c39b83f31473696c9b249ab49d780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55dde8892fa47bd9941bb1ce9aa3673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:10:05.261521 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-ca47a07d-638c-44f0-95ca-3f00d060a292 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] 10.222.0.79 "GET /compute/v2.1/servers/9b886ef6-6c08-4ed8-9d10-35c49c2c6382" status: 200 len: 1271 microversion: 2.1 time: 0.280258 Jan 28 02:10:05.262811 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 318/674] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:10:04 2022] GET /compute/v2.1/servers/9b886ef6-6c08-4ed8-9d10-35c49c2c6382 => generated 1271 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:10:05.432111 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-ca06e368-c9e8-48c9-abeb-cbcb4508f317 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b019715a14074e059730965913694e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b66ddee4c864aae90b738695dffbeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:10:05.440476 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-ca06e368-c9e8-48c9-abeb-cbcb4508f317 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] 10.222.0.79 "GET /compute/v2.1/servers/9f152f23-7594-4edf-b4f9-55a5e612e3b2" status: 200 len: 1317 microversion: 2.1 time: 0.318702 Jan 28 02:10:05.441147 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 357/675] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:10:05 2022] GET /compute/v2.1/servers/9f152f23-7594-4edf-b4f9-55a5e612e3b2 => generated 1317 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:10:05.858505 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-30d94dd5-6f98-47d1-9bba-4bc697930b72 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:10:05.859939 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-30d94dd5-6f98-47d1-9bba-4bc697930b72 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: d5f49055-da38-486c-9f10-1658c64d46f5] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:10:05.866269 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-30d94dd5-6f98-47d1-9bba-4bc697930b72 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:05.866711 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-30d94dd5-6f98-47d1-9bba-4bc697930b72 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:05.867474 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-30d94dd5-6f98-47d1-9bba-4bc697930b72 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:05.867899 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-30d94dd5-6f98-47d1-9bba-4bc697930b72 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:06.079047 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-30d94dd5-6f98-47d1-9bba-4bc697930b72 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acab2a0c4a0e48909317791a3de85b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abe012ba65845329098e0e06c54b9c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:10:06.086565 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-30d94dd5-6f98-47d1-9bba-4bc697930b72 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "GET /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5" status: 200 len: 1677 microversion: 2.1 time: 0.231773 Jan 28 02:10:06.087497 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 319/676] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:10:05 2022] GET /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5 => generated 1677 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:10:06.224212 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [req-de0580cc-4bfc-484f-8614-48c61ddc880f req-c0c2af9d-9b18-411b-ba62-478c2a45587a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b886ef6-6c08-4ed8-9d10-35c49c2c6382", "tag": "7b4575d4-25de-48a0-8c88-24340312c99a"}]} {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:10:06.226812 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:10:06.226812 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: warnings.warn(msg) Jan 28 02:10:06.235993 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [req-de0580cc-4bfc-484f-8614-48c61ddc880f req-c0c2af9d-9b18-411b-ba62-478c2a45587a service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:06.235993 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [req-de0580cc-4bfc-484f-8614-48c61ddc880f req-c0c2af9d-9b18-411b-ba62-478c2a45587a service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:06.255939 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.compute.server_external_events [req-de0580cc-4bfc-484f-8614-48c61ddc880f req-c0c2af9d-9b18-411b-ba62-478c2a45587a service nova] Creating event network-changed:7b4575d4-25de-48a0-8c88-24340312c99a for instance 9b886ef6-6c08-4ed8-9d10-35c49c2c6382 on hv-cinder-82497 Jan 28 02:10:06.261864 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [req-de0580cc-4bfc-484f-8614-48c61ddc880f req-c0c2af9d-9b18-411b-ba62-478c2a45587a service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042360 Jan 28 02:10:06.262655 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 358/677] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Jan 28 02:10:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:10:06.282676 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-b6fd2145-84ec-4d7a-8ccf-7153c333ef7d tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:10:06.283271 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-b6fd2145-84ec-4d7a-8ccf-7153c333ef7d tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] [instance: 9b886ef6-6c08-4ed8-9d10-35c49c2c6382] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:10:06.290048 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b6fd2145-84ec-4d7a-8ccf-7153c333ef7d tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:06.290497 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b6fd2145-84ec-4d7a-8ccf-7153c333ef7d tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:06.291427 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b6fd2145-84ec-4d7a-8ccf-7153c333ef7d tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:06.291703 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b6fd2145-84ec-4d7a-8ccf-7153c333ef7d tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:06.459001 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-9cdb4ec3-8072-45e9-9c1b-7f8b9ce8dfae tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:10:06.459697 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-9cdb4ec3-8072-45e9-9c1b-7f8b9ce8dfae tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] [instance: 9f152f23-7594-4edf-b4f9-55a5e612e3b2] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:10:06.465770 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-9cdb4ec3-8072-45e9-9c1b-7f8b9ce8dfae tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:06.466218 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-9cdb4ec3-8072-45e9-9c1b-7f8b9ce8dfae tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:06.466988 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-9cdb4ec3-8072-45e9-9c1b-7f8b9ce8dfae tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:06.467417 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-9cdb4ec3-8072-45e9-9c1b-7f8b9ce8dfae tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:06.477348 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-b6fd2145-84ec-4d7a-8ccf-7153c333ef7d tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5c39b83f31473696c9b249ab49d780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55dde8892fa47bd9941bb1ce9aa3673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:10:06.491113 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-b6fd2145-84ec-4d7a-8ccf-7153c333ef7d tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] 10.222.0.79 "GET /compute/v2.1/servers/9b886ef6-6c08-4ed8-9d10-35c49c2c6382" status: 200 len: 1259 microversion: 2.1 time: 0.212662 Jan 28 02:10:06.492583 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 320/678] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:10:06 2022] GET /compute/v2.1/servers/9b886ef6-6c08-4ed8-9d10-35c49c2c6382 => generated 1259 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:10:06.668830 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-9cdb4ec3-8072-45e9-9c1b-7f8b9ce8dfae tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b019715a14074e059730965913694e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b66ddee4c864aae90b738695dffbeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:10:06.677110 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-9cdb4ec3-8072-45e9-9c1b-7f8b9ce8dfae tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] 10.222.0.79 "GET /compute/v2.1/servers/9f152f23-7594-4edf-b4f9-55a5e612e3b2" status: 200 len: 1317 microversion: 2.1 time: 0.222519 Jan 28 02:10:06.677692 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 359/679] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:10:06 2022] GET /compute/v2.1/servers/9f152f23-7594-4edf-b4f9-55a5e612e3b2 => generated 1317 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:10:07.104686 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-92d041ae-a333-41d5-9ea8-3c23d0d6f292 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:10:07.111084 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-92d041ae-a333-41d5-9ea8-3c23d0d6f292 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: d5f49055-da38-486c-9f10-1658c64d46f5] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:10:07.116857 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-92d041ae-a333-41d5-9ea8-3c23d0d6f292 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:07.117407 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-92d041ae-a333-41d5-9ea8-3c23d0d6f292 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:07.119424 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-92d041ae-a333-41d5-9ea8-3c23d0d6f292 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:07.119858 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-92d041ae-a333-41d5-9ea8-3c23d0d6f292 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:07.305708 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-92d041ae-a333-41d5-9ea8-3c23d0d6f292 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acab2a0c4a0e48909317791a3de85b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abe012ba65845329098e0e06c54b9c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:10:07.316901 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-92d041ae-a333-41d5-9ea8-3c23d0d6f292 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "GET /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5" status: 200 len: 1677 microversion: 2.1 time: 0.212730 Jan 28 02:10:07.317560 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 321/680] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:10:07 2022] GET /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5 => generated 1677 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:10:07.509618 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-b46f4dc2-6c33-4e64-850a-ea42dfe7fa93 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:10:07.510296 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-b46f4dc2-6c33-4e64-850a-ea42dfe7fa93 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] [instance: 9b886ef6-6c08-4ed8-9d10-35c49c2c6382] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:10:07.516715 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-b46f4dc2-6c33-4e64-850a-ea42dfe7fa93 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:07.517154 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-b46f4dc2-6c33-4e64-850a-ea42dfe7fa93 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:07.517898 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-b46f4dc2-6c33-4e64-850a-ea42dfe7fa93 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:07.518320 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-b46f4dc2-6c33-4e64-850a-ea42dfe7fa93 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:07.641598 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-b46f4dc2-6c33-4e64-850a-ea42dfe7fa93 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5c39b83f31473696c9b249ab49d780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55dde8892fa47bd9941bb1ce9aa3673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:10:07.649636 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-b46f4dc2-6c33-4e64-850a-ea42dfe7fa93 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] 10.222.0.79 "GET /compute/v2.1/servers/9b886ef6-6c08-4ed8-9d10-35c49c2c6382" status: 200 len: 1259 microversion: 2.1 time: 0.143044 Jan 28 02:10:07.649636 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 360/681] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:10:07 2022] GET /compute/v2.1/servers/9b886ef6-6c08-4ed8-9d10-35c49c2c6382 => generated 1259 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:10:07.693774 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-68e82ee4-b0dc-45c9-ab00-7d1c28b6869b tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:10:07.694466 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-68e82ee4-b0dc-45c9-ab00-7d1c28b6869b tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] [instance: 9f152f23-7594-4edf-b4f9-55a5e612e3b2] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:10:07.700186 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-68e82ee4-b0dc-45c9-ab00-7d1c28b6869b tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:07.703030 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-68e82ee4-b0dc-45c9-ab00-7d1c28b6869b tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:07.703030 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-68e82ee4-b0dc-45c9-ab00-7d1c28b6869b tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:07.703030 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-68e82ee4-b0dc-45c9-ab00-7d1c28b6869b tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:07.830332 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-68e82ee4-b0dc-45c9-ab00-7d1c28b6869b tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b019715a14074e059730965913694e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b66ddee4c864aae90b738695dffbeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:10:07.838123 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-68e82ee4-b0dc-45c9-ab00-7d1c28b6869b tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] 10.222.0.79 "GET /compute/v2.1/servers/9f152f23-7594-4edf-b4f9-55a5e612e3b2" status: 200 len: 1507 microversion: 2.1 time: 0.148078 Jan 28 02:10:07.838686 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 322/682] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:10:07 2022] GET /compute/v2.1/servers/9f152f23-7594-4edf-b4f9-55a5e612e3b2 => generated 1507 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:10:08.334290 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-925368c4-7abb-40fc-8e45-3d4ffa4d0dfe tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:10:08.334898 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-925368c4-7abb-40fc-8e45-3d4ffa4d0dfe tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: d5f49055-da38-486c-9f10-1658c64d46f5] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:10:08.341552 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-925368c4-7abb-40fc-8e45-3d4ffa4d0dfe tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:08.342013 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-925368c4-7abb-40fc-8e45-3d4ffa4d0dfe tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:08.342841 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-925368c4-7abb-40fc-8e45-3d4ffa4d0dfe tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:08.343667 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-925368c4-7abb-40fc-8e45-3d4ffa4d0dfe tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:08.477760 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-925368c4-7abb-40fc-8e45-3d4ffa4d0dfe tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acab2a0c4a0e48909317791a3de85b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abe012ba65845329098e0e06c54b9c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:10:08.485512 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-925368c4-7abb-40fc-8e45-3d4ffa4d0dfe tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "GET /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5" status: 200 len: 1677 microversion: 2.1 time: 0.155072 Jan 28 02:10:08.486277 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 361/683] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:10:08 2022] GET /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5 => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:10:08.669196 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-16e420bb-05bf-4f80-aa58-32705d7fd8cf tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:10:08.670079 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-16e420bb-05bf-4f80-aa58-32705d7fd8cf tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] [instance: 9b886ef6-6c08-4ed8-9d10-35c49c2c6382] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:10:08.677060 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-16e420bb-05bf-4f80-aa58-32705d7fd8cf tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:08.677793 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-16e420bb-05bf-4f80-aa58-32705d7fd8cf tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:08.679038 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-16e420bb-05bf-4f80-aa58-32705d7fd8cf tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:08.680282 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-16e420bb-05bf-4f80-aa58-32705d7fd8cf tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:08.807774 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-16e420bb-05bf-4f80-aa58-32705d7fd8cf tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5c39b83f31473696c9b249ab49d780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55dde8892fa47bd9941bb1ce9aa3673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:10:08.815325 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-16e420bb-05bf-4f80-aa58-32705d7fd8cf tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] 10.222.0.79 "GET /compute/v2.1/servers/9b886ef6-6c08-4ed8-9d10-35c49c2c6382" status: 200 len: 1259 microversion: 2.1 time: 0.152279 Jan 28 02:10:08.815893 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 323/684] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:10:08 2022] GET /compute/v2.1/servers/9b886ef6-6c08-4ed8-9d10-35c49c2c6382 => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:10:09.502959 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-a57eb785-b808-46c6-bd86-7f2e8cf5aec7 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:10:09.503802 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-a57eb785-b808-46c6-bd86-7f2e8cf5aec7 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: d5f49055-da38-486c-9f10-1658c64d46f5] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:10:09.510122 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-a57eb785-b808-46c6-bd86-7f2e8cf5aec7 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:09.510568 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-a57eb785-b808-46c6-bd86-7f2e8cf5aec7 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:09.511333 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-a57eb785-b808-46c6-bd86-7f2e8cf5aec7 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:09.511765 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-a57eb785-b808-46c6-bd86-7f2e8cf5aec7 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:09.552061 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-2e1308da-0441-4100-aa3d-5423d31bdc0b tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2e26c42f-b3dc-4c4a-8296-946ff4ad9b2f"}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:10:09.553183 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-2e1308da-0441-4100-aa3d-5423d31bdc0b tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] [instance: 9f152f23-7594-4edf-b4f9-55a5e612e3b2] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:10:09.558969 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2e1308da-0441-4100-aa3d-5423d31bdc0b tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:09.559411 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2e1308da-0441-4100-aa3d-5423d31bdc0b tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:09.560213 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2e1308da-0441-4100-aa3d-5423d31bdc0b tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:09.560624 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2e1308da-0441-4100-aa3d-5423d31bdc0b tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:09.638956 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-a57eb785-b808-46c6-bd86-7f2e8cf5aec7 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acab2a0c4a0e48909317791a3de85b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abe012ba65845329098e0e06c54b9c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:10:09.648056 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-a57eb785-b808-46c6-bd86-7f2e8cf5aec7 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "GET /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5" status: 200 len: 1677 microversion: 2.1 time: 0.149419 Jan 28 02:10:09.648834 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 362/685] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:10:09 2022] GET /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5 => generated 1677 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:10:09.831716 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-68355554-ca03-4fb7-91f7-155c11281b00 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:10:09.832747 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-68355554-ca03-4fb7-91f7-155c11281b00 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] [instance: 9b886ef6-6c08-4ed8-9d10-35c49c2c6382] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:10:09.838634 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-68355554-ca03-4fb7-91f7-155c11281b00 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:09.839232 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-68355554-ca03-4fb7-91f7-155c11281b00 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:09.840217 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-68355554-ca03-4fb7-91f7-155c11281b00 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:09.840653 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-68355554-ca03-4fb7-91f7-155c11281b00 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:09.965018 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-68355554-ca03-4fb7-91f7-155c11281b00 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5c39b83f31473696c9b249ab49d780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55dde8892fa47bd9941bb1ce9aa3673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:10:09.973381 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-68355554-ca03-4fb7-91f7-155c11281b00 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] 10.222.0.79 "GET /compute/v2.1/servers/9b886ef6-6c08-4ed8-9d10-35c49c2c6382" status: 200 len: 1259 microversion: 2.1 time: 0.145877 Jan 28 02:10:09.973951 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 363/686] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:10:09 2022] GET /compute/v2.1/servers/9b886ef6-6c08-4ed8-9d10-35c49c2c6382 => generated 1259 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:10:10.265757 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-2e1308da-0441-4100-aa3d-5423d31bdc0b tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] 10.222.0.79 "POST /compute/v2.1/servers/9f152f23-7594-4edf-b4f9-55a5e612e3b2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.717343 Jan 28 02:10:10.266477 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 324/687] 10.222.0.79 () {60 vars in 1322 bytes} [Fri Jan 28 02:10:09 2022] POST /compute/v2.1/servers/9f152f23-7594-4edf-b4f9-55a5e612e3b2/os-volume_attachments => generated 194 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:10:10.665745 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-bc3d6a5d-2419-4c3a-9c51-f51fa8b54195 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:10:10.666380 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-bc3d6a5d-2419-4c3a-9c51-f51fa8b54195 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: d5f49055-da38-486c-9f10-1658c64d46f5] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:10:10.672267 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-bc3d6a5d-2419-4c3a-9c51-f51fa8b54195 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:10.672710 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-bc3d6a5d-2419-4c3a-9c51-f51fa8b54195 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:10.673530 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-bc3d6a5d-2419-4c3a-9c51-f51fa8b54195 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:10.673956 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-bc3d6a5d-2419-4c3a-9c51-f51fa8b54195 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:10.798601 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-bc3d6a5d-2419-4c3a-9c51-f51fa8b54195 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acab2a0c4a0e48909317791a3de85b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abe012ba65845329098e0e06c54b9c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:10:10.805893 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-bc3d6a5d-2419-4c3a-9c51-f51fa8b54195 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "GET /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5" status: 200 len: 1677 microversion: 2.1 time: 0.143746 Jan 28 02:10:10.806456 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 364/688] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:10:10 2022] GET /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5 => generated 1677 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:10:10.990613 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-f622c5bc-03c0-4dc8-b090-cb13c8bb92ac tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:10:10.991302 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-f622c5bc-03c0-4dc8-b090-cb13c8bb92ac tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] [instance: 9b886ef6-6c08-4ed8-9d10-35c49c2c6382] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:10:10.997294 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f622c5bc-03c0-4dc8-b090-cb13c8bb92ac tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:10.997738 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f622c5bc-03c0-4dc8-b090-cb13c8bb92ac tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:10.998489 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f622c5bc-03c0-4dc8-b090-cb13c8bb92ac tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:10.998915 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f622c5bc-03c0-4dc8-b090-cb13c8bb92ac tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:11.386934 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-f622c5bc-03c0-4dc8-b090-cb13c8bb92ac tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5c39b83f31473696c9b249ab49d780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55dde8892fa47bd9941bb1ce9aa3673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:10:11.394544 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-f622c5bc-03c0-4dc8-b090-cb13c8bb92ac tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] 10.222.0.79 "GET /compute/v2.1/servers/9b886ef6-6c08-4ed8-9d10-35c49c2c6382" status: 200 len: 1259 microversion: 2.1 time: 0.408469 Jan 28 02:10:11.395105 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 325/689] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:10:10 2022] GET /compute/v2.1/servers/9b886ef6-6c08-4ed8-9d10-35c49c2c6382 => generated 1259 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:10:11.822256 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-f8099db0-279c-409c-8be1-8ad9781b4af2 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:10:11.822870 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-f8099db0-279c-409c-8be1-8ad9781b4af2 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: d5f49055-da38-486c-9f10-1658c64d46f5] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:10:11.828791 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-f8099db0-279c-409c-8be1-8ad9781b4af2 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:11.829236 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-f8099db0-279c-409c-8be1-8ad9781b4af2 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:11.829996 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-f8099db0-279c-409c-8be1-8ad9781b4af2 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:11.830426 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-f8099db0-279c-409c-8be1-8ad9781b4af2 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:11.950489 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-f8099db0-279c-409c-8be1-8ad9781b4af2 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acab2a0c4a0e48909317791a3de85b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abe012ba65845329098e0e06c54b9c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:10:11.958350 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-f8099db0-279c-409c-8be1-8ad9781b4af2 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "GET /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5" status: 200 len: 1677 microversion: 2.1 time: 0.139711 Jan 28 02:10:11.958918 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 365/690] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:10:11 2022] GET /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5 => generated 1677 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:10:12.411812 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-7a18fa31-4b71-4bbc-9f52-250c568bfa68 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:10:12.412470 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-7a18fa31-4b71-4bbc-9f52-250c568bfa68 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] [instance: 9b886ef6-6c08-4ed8-9d10-35c49c2c6382] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:10:12.418515 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-7a18fa31-4b71-4bbc-9f52-250c568bfa68 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:12.418728 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-7a18fa31-4b71-4bbc-9f52-250c568bfa68 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:12.419499 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-7a18fa31-4b71-4bbc-9f52-250c568bfa68 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:12.419958 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-7a18fa31-4b71-4bbc-9f52-250c568bfa68 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:12.540612 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-7a18fa31-4b71-4bbc-9f52-250c568bfa68 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5c39b83f31473696c9b249ab49d780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55dde8892fa47bd9941bb1ce9aa3673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:10:12.548862 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-7a18fa31-4b71-4bbc-9f52-250c568bfa68 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] 10.222.0.79 "GET /compute/v2.1/servers/9b886ef6-6c08-4ed8-9d10-35c49c2c6382" status: 200 len: 1259 microversion: 2.1 time: 0.140684 Jan 28 02:10:12.549448 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 326/691] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:10:12 2022] GET /compute/v2.1/servers/9b886ef6-6c08-4ed8-9d10-35c49c2c6382 => generated 1259 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:10:12.976268 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-e3350a2d-36da-4f9a-a29c-c739bb39efed tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:10:12.976868 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-e3350a2d-36da-4f9a-a29c-c739bb39efed tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: d5f49055-da38-486c-9f10-1658c64d46f5] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:10:12.982922 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-e3350a2d-36da-4f9a-a29c-c739bb39efed tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:12.983371 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-e3350a2d-36da-4f9a-a29c-c739bb39efed tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:12.984156 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-e3350a2d-36da-4f9a-a29c-c739bb39efed tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:12.984657 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-e3350a2d-36da-4f9a-a29c-c739bb39efed tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:13.120508 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-e3350a2d-36da-4f9a-a29c-c739bb39efed tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acab2a0c4a0e48909317791a3de85b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abe012ba65845329098e0e06c54b9c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:10:13.127801 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-e3350a2d-36da-4f9a-a29c-c739bb39efed tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "GET /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5" status: 200 len: 1677 microversion: 2.1 time: 0.155286 Jan 28 02:10:13.128408 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 366/692] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:10:12 2022] GET /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5 => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:10:13.565996 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-fe4dd9ba-83d5-4fe1-916a-a9c8af6ff26d tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:10:13.566602 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-fe4dd9ba-83d5-4fe1-916a-a9c8af6ff26d tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] [instance: 9b886ef6-6c08-4ed8-9d10-35c49c2c6382] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:10:13.572984 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-fe4dd9ba-83d5-4fe1-916a-a9c8af6ff26d tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:13.573427 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-fe4dd9ba-83d5-4fe1-916a-a9c8af6ff26d tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:13.574184 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-fe4dd9ba-83d5-4fe1-916a-a9c8af6ff26d tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:13.574616 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-fe4dd9ba-83d5-4fe1-916a-a9c8af6ff26d tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:13.697913 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-fe4dd9ba-83d5-4fe1-916a-a9c8af6ff26d tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5c39b83f31473696c9b249ab49d780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55dde8892fa47bd9941bb1ce9aa3673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:10:13.706390 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-fe4dd9ba-83d5-4fe1-916a-a9c8af6ff26d tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] 10.222.0.79 "GET /compute/v2.1/servers/9b886ef6-6c08-4ed8-9d10-35c49c2c6382" status: 200 len: 1259 microversion: 2.1 time: 0.144663 Jan 28 02:10:13.707013 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 327/693] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:10:13 2022] GET /compute/v2.1/servers/9b886ef6-6c08-4ed8-9d10-35c49c2c6382 => generated 1259 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:10:14.145296 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-1418c8ac-4de0-409c-93eb-c71eca6cf1ba tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:10:14.145926 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-1418c8ac-4de0-409c-93eb-c71eca6cf1ba tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: d5f49055-da38-486c-9f10-1658c64d46f5] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:10:14.151816 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-1418c8ac-4de0-409c-93eb-c71eca6cf1ba tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:14.152291 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-1418c8ac-4de0-409c-93eb-c71eca6cf1ba tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:14.153515 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-1418c8ac-4de0-409c-93eb-c71eca6cf1ba tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:14.153515 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-1418c8ac-4de0-409c-93eb-c71eca6cf1ba tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:14.276153 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-1418c8ac-4de0-409c-93eb-c71eca6cf1ba tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acab2a0c4a0e48909317791a3de85b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abe012ba65845329098e0e06c54b9c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:10:14.284061 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-1418c8ac-4de0-409c-93eb-c71eca6cf1ba tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "GET /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5" status: 200 len: 1677 microversion: 2.1 time: 0.143030 Jan 28 02:10:14.284621 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 367/694] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:10:14 2022] GET /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5 => generated 1677 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:10:14.724056 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-4dda52e5-d262-4564-9133-5e6bec4154ce tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:10:14.724736 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-4dda52e5-d262-4564-9133-5e6bec4154ce tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] [instance: 9b886ef6-6c08-4ed8-9d10-35c49c2c6382] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:10:14.730606 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-4dda52e5-d262-4564-9133-5e6bec4154ce tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:14.731053 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-4dda52e5-d262-4564-9133-5e6bec4154ce tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:14.731815 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-4dda52e5-d262-4564-9133-5e6bec4154ce tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:14.732275 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-4dda52e5-d262-4564-9133-5e6bec4154ce tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:14.853510 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-4dda52e5-d262-4564-9133-5e6bec4154ce tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5c39b83f31473696c9b249ab49d780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55dde8892fa47bd9941bb1ce9aa3673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:10:14.861331 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-4dda52e5-d262-4564-9133-5e6bec4154ce tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] 10.222.0.79 "GET /compute/v2.1/servers/9b886ef6-6c08-4ed8-9d10-35c49c2c6382" status: 200 len: 1259 microversion: 2.1 time: 0.140947 Jan 28 02:10:14.861899 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 328/695] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:10:14 2022] GET /compute/v2.1/servers/9b886ef6-6c08-4ed8-9d10-35c49c2c6382 => generated 1259 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:10:15.301664 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-e3a36750-3431-4f13-a24b-a7c1d2502f57 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:10:15.302266 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-e3a36750-3431-4f13-a24b-a7c1d2502f57 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: d5f49055-da38-486c-9f10-1658c64d46f5] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:10:15.308396 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-e3a36750-3431-4f13-a24b-a7c1d2502f57 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:15.309013 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-e3a36750-3431-4f13-a24b-a7c1d2502f57 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:15.309944 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-e3a36750-3431-4f13-a24b-a7c1d2502f57 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:15.310854 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-e3a36750-3431-4f13-a24b-a7c1d2502f57 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:15.434459 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-e3a36750-3431-4f13-a24b-a7c1d2502f57 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acab2a0c4a0e48909317791a3de85b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abe012ba65845329098e0e06c54b9c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:10:15.442454 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-e3a36750-3431-4f13-a24b-a7c1d2502f57 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "GET /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5" status: 200 len: 1677 microversion: 2.1 time: 0.145095 Jan 28 02:10:15.443025 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 368/696] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:10:15 2022] GET /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5 => generated 1677 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:10:15.878491 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-bd1ba4f6-5a2d-4cd3-b22a-02bdef3ce374 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:10:15.879100 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-bd1ba4f6-5a2d-4cd3-b22a-02bdef3ce374 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] [instance: 9b886ef6-6c08-4ed8-9d10-35c49c2c6382] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:10:15.885188 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-bd1ba4f6-5a2d-4cd3-b22a-02bdef3ce374 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:15.885628 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-bd1ba4f6-5a2d-4cd3-b22a-02bdef3ce374 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:15.886403 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-bd1ba4f6-5a2d-4cd3-b22a-02bdef3ce374 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:15.886831 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-bd1ba4f6-5a2d-4cd3-b22a-02bdef3ce374 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:16.027889 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-bd1ba4f6-5a2d-4cd3-b22a-02bdef3ce374 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5c39b83f31473696c9b249ab49d780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55dde8892fa47bd9941bb1ce9aa3673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:10:16.036542 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-bd1ba4f6-5a2d-4cd3-b22a-02bdef3ce374 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] 10.222.0.79 "GET /compute/v2.1/servers/9b886ef6-6c08-4ed8-9d10-35c49c2c6382" status: 200 len: 1259 microversion: 2.1 time: 0.162615 Jan 28 02:10:16.037116 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 329/697] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:10:15 2022] GET /compute/v2.1/servers/9b886ef6-6c08-4ed8-9d10-35c49c2c6382 => generated 1259 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:10:16.462816 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-d3d081c3-16b1-4423-8a9b-1724580e993a tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:10:16.463532 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-d3d081c3-16b1-4423-8a9b-1724580e993a tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: d5f49055-da38-486c-9f10-1658c64d46f5] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:10:16.470828 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-d3d081c3-16b1-4423-8a9b-1724580e993a tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:16.471267 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-d3d081c3-16b1-4423-8a9b-1724580e993a tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:16.472129 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-d3d081c3-16b1-4423-8a9b-1724580e993a tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:16.472555 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-d3d081c3-16b1-4423-8a9b-1724580e993a tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:16.616106 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-d3d081c3-16b1-4423-8a9b-1724580e993a tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acab2a0c4a0e48909317791a3de85b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abe012ba65845329098e0e06c54b9c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:10:16.623378 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-d3d081c3-16b1-4423-8a9b-1724580e993a tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "GET /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5" status: 200 len: 1654 microversion: 2.1 time: 0.166787 Jan 28 02:10:16.623947 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 369/698] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:10:16 2022] GET /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5 => generated 1654 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:10:16.639751 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-6d34fff9-b084-457d-8d40-0fcd47e037d2 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:10:16.647764 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-6d34fff9-b084-457d-8d40-0fcd47e037d2 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:16.647764 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-6d34fff9-b084-457d-8d40-0fcd47e037d2 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:16.671613 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-6d34fff9-b084-457d-8d40-0fcd47e037d2 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: d5f49055-da38-486c-9f10-1658c64d46f5] Going to try to start instance {{(pid=116375) start /opt/stack/nova/nova/compute/api.py:2675}} Jan 28 02:10:16.904537 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-6d34fff9-b084-457d-8d40-0fcd47e037d2 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "POST /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5/action" status: 202 len: 0 microversion: 2.1 time: 0.267952 Jan 28 02:10:16.905139 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 330/699] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Jan 28 02:10:16 2022] POST /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5/action => generated 0 bytes in 270 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:10:16.914134 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-e5cf162f-5013-4ace-b2a0-ef9bf0a6692d tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:10:16.914657 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-e5cf162f-5013-4ace-b2a0-ef9bf0a6692d tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: d5f49055-da38-486c-9f10-1658c64d46f5] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:10:16.920515 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-e5cf162f-5013-4ace-b2a0-ef9bf0a6692d tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:16.920989 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-e5cf162f-5013-4ace-b2a0-ef9bf0a6692d tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:16.921743 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-e5cf162f-5013-4ace-b2a0-ef9bf0a6692d tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:16.922213 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-e5cf162f-5013-4ace-b2a0-ef9bf0a6692d tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:17.050570 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-e5cf162f-5013-4ace-b2a0-ef9bf0a6692d tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acab2a0c4a0e48909317791a3de85b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abe012ba65845329098e0e06c54b9c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:10:17.056085 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-be22ecb4-121c-4e9b-b312-b818575331a9 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:10:17.056814 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-be22ecb4-121c-4e9b-b312-b818575331a9 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] [instance: 9b886ef6-6c08-4ed8-9d10-35c49c2c6382] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:10:17.058098 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-e5cf162f-5013-4ace-b2a0-ef9bf0a6692d tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "GET /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5" status: 200 len: 1663 microversion: 2.1 time: 0.148647 Jan 28 02:10:17.058723 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 370/700] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:10:16 2022] GET /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5 => generated 1663 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:10:17.063509 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-be22ecb4-121c-4e9b-b312-b818575331a9 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:17.064071 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-be22ecb4-121c-4e9b-b312-b818575331a9 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:17.064914 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-be22ecb4-121c-4e9b-b312-b818575331a9 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:17.065342 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-be22ecb4-121c-4e9b-b312-b818575331a9 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:17.279344 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-be22ecb4-121c-4e9b-b312-b818575331a9 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5c39b83f31473696c9b249ab49d780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55dde8892fa47bd9941bb1ce9aa3673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:10:17.287168 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-be22ecb4-121c-4e9b-b312-b818575331a9 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] 10.222.0.79 "GET /compute/v2.1/servers/9b886ef6-6c08-4ed8-9d10-35c49c2c6382" status: 200 len: 1259 microversion: 2.1 time: 0.235139 Jan 28 02:10:17.287746 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 331/701] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:10:17 2022] GET /compute/v2.1/servers/9b886ef6-6c08-4ed8-9d10-35c49c2c6382 => generated 1259 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:10:18.075873 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-3ccf57d3-93c8-47e7-a5a0-48b783184fde tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:10:18.076544 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-3ccf57d3-93c8-47e7-a5a0-48b783184fde tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: d5f49055-da38-486c-9f10-1658c64d46f5] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:10:18.083350 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-3ccf57d3-93c8-47e7-a5a0-48b783184fde tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:18.083797 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-3ccf57d3-93c8-47e7-a5a0-48b783184fde tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:18.084623 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-3ccf57d3-93c8-47e7-a5a0-48b783184fde tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:18.085060 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-3ccf57d3-93c8-47e7-a5a0-48b783184fde tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:18.208300 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-3ccf57d3-93c8-47e7-a5a0-48b783184fde tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acab2a0c4a0e48909317791a3de85b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abe012ba65845329098e0e06c54b9c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:10:18.216454 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-3ccf57d3-93c8-47e7-a5a0-48b783184fde tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "GET /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5" status: 200 len: 1663 microversion: 2.1 time: 0.144132 Jan 28 02:10:18.217026 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 371/702] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:10:18 2022] GET /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5 => generated 1663 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:10:18.304414 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-633e44b0-5040-43b2-b71f-711375f65ae0 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:10:18.305086 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-633e44b0-5040-43b2-b71f-711375f65ae0 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] [instance: 9b886ef6-6c08-4ed8-9d10-35c49c2c6382] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:10:18.312030 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-633e44b0-5040-43b2-b71f-711375f65ae0 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:18.312599 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-633e44b0-5040-43b2-b71f-711375f65ae0 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:18.313962 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-633e44b0-5040-43b2-b71f-711375f65ae0 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:18.314390 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-633e44b0-5040-43b2-b71f-711375f65ae0 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:18.451598 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-633e44b0-5040-43b2-b71f-711375f65ae0 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5c39b83f31473696c9b249ab49d780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55dde8892fa47bd9941bb1ce9aa3673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:10:18.459966 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-633e44b0-5040-43b2-b71f-711375f65ae0 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] 10.222.0.79 "GET /compute/v2.1/servers/9b886ef6-6c08-4ed8-9d10-35c49c2c6382" status: 200 len: 1259 microversion: 2.1 time: 0.159288 Jan 28 02:10:18.460557 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 332/703] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:10:18 2022] GET /compute/v2.1/servers/9b886ef6-6c08-4ed8-9d10-35c49c2c6382 => generated 1259 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:10:18.969306 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-5768c2f6-2890-4099-84f7-8ea3b7e4672d tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:10:18.970042 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-5768c2f6-2890-4099-84f7-8ea3b7e4672d tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] [instance: 9f152f23-7594-4edf-b4f9-55a5e612e3b2] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:10:18.975962 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-5768c2f6-2890-4099-84f7-8ea3b7e4672d tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:18.976425 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-5768c2f6-2890-4099-84f7-8ea3b7e4672d tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:18.977181 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-5768c2f6-2890-4099-84f7-8ea3b7e4672d tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:18.977607 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-5768c2f6-2890-4099-84f7-8ea3b7e4672d tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:19.062262 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.objects.instance [None req-5768c2f6-2890-4099-84f7-8ea3b7e4672d tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lazy-loading 'services' on Instance uuid 9f152f23-7594-4edf-b4f9-55a5e612e3b2 {{(pid=116374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jan 28 02:10:19.234173 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-f603abf0-c059-479d-a00a-0678432d407c tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:10:19.235405 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-f603abf0-c059-479d-a00a-0678432d407c tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: d5f49055-da38-486c-9f10-1658c64d46f5] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:10:19.241188 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f603abf0-c059-479d-a00a-0678432d407c tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:19.241627 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f603abf0-c059-479d-a00a-0678432d407c tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:19.242378 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f603abf0-c059-479d-a00a-0678432d407c tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:19.242803 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f603abf0-c059-479d-a00a-0678432d407c tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:19.318374 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-5768c2f6-2890-4099-84f7-8ea3b7e4672d tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] 10.222.0.79 "DELETE /compute/v2.1/servers/9f152f23-7594-4edf-b4f9-55a5e612e3b2/os-volume_attachments/2e26c42f-b3dc-4c4a-8296-946ff4ad9b2f" status: 202 len: 0 microversion: 2.1 time: 0.352469 Jan 28 02:10:19.319703 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 372/704] 10.222.0.79 () {58 vars in 1415 bytes} [Fri Jan 28 02:10:18 2022] DELETE /compute/v2.1/servers/9f152f23-7594-4edf-b4f9-55a5e612e3b2/os-volume_attachments/2e26c42f-b3dc-4c4a-8296-946ff4ad9b2f => generated 0 bytes in 355 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:10:19.328474 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-3b97ef33-7ef6-4b47-a874-80d345ac6b97 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:10:19.329852 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-3b97ef33-7ef6-4b47-a874-80d345ac6b97 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] [instance: 9f152f23-7594-4edf-b4f9-55a5e612e3b2] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:10:19.336242 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-3b97ef33-7ef6-4b47-a874-80d345ac6b97 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:19.336680 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-3b97ef33-7ef6-4b47-a874-80d345ac6b97 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:19.337440 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-3b97ef33-7ef6-4b47-a874-80d345ac6b97 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:19.337861 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-3b97ef33-7ef6-4b47-a874-80d345ac6b97 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:19.370104 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-3b97ef33-7ef6-4b47-a874-80d345ac6b97 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] 10.222.0.79 "GET /compute/v2.1/servers/9f152f23-7594-4edf-b4f9-55a5e612e3b2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045944 Jan 28 02:10:19.370667 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 373/705] 10.222.0.79 () {58 vars in 1301 bytes} [Fri Jan 28 02:10:19 2022] GET /compute/v2.1/servers/9f152f23-7594-4edf-b4f9-55a5e612e3b2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 02:10:19.379126 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-f603abf0-c059-479d-a00a-0678432d407c tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acab2a0c4a0e48909317791a3de85b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abe012ba65845329098e0e06c54b9c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:10:19.386300 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-f603abf0-c059-479d-a00a-0678432d407c tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "GET /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5" status: 200 len: 1667 microversion: 2.1 time: 0.155538 Jan 28 02:10:19.386925 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 333/706] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:10:19 2022] GET /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5 => generated 1667 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:10:19.478911 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-2155e34a-c3c3-4be9-b95f-de99c02a29ec tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:10:19.479510 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-2155e34a-c3c3-4be9-b95f-de99c02a29ec tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] [instance: 9b886ef6-6c08-4ed8-9d10-35c49c2c6382] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:10:19.485568 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-2155e34a-c3c3-4be9-b95f-de99c02a29ec tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:19.486011 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-2155e34a-c3c3-4be9-b95f-de99c02a29ec tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:19.486829 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-2155e34a-c3c3-4be9-b95f-de99c02a29ec tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:19.487279 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-2155e34a-c3c3-4be9-b95f-de99c02a29ec tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:19.608087 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-2155e34a-c3c3-4be9-b95f-de99c02a29ec tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5c39b83f31473696c9b249ab49d780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55dde8892fa47bd9941bb1ce9aa3673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:10:19.616000 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-2155e34a-c3c3-4be9-b95f-de99c02a29ec tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] 10.222.0.79 "GET /compute/v2.1/servers/9b886ef6-6c08-4ed8-9d10-35c49c2c6382" status: 200 len: 1259 microversion: 2.1 time: 0.140894 Jan 28 02:10:19.616589 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 374/707] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:10:19 2022] GET /compute/v2.1/servers/9b886ef6-6c08-4ed8-9d10-35c49c2c6382 => generated 1259 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:10:20.382756 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-2fbfd140-f2d3-4f75-8834-c00894b81517 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:10:20.383726 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-2fbfd140-f2d3-4f75-8834-c00894b81517 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] [instance: 9f152f23-7594-4edf-b4f9-55a5e612e3b2] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:10:20.389737 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2fbfd140-f2d3-4f75-8834-c00894b81517 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:20.390228 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2fbfd140-f2d3-4f75-8834-c00894b81517 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:20.391235 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2fbfd140-f2d3-4f75-8834-c00894b81517 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:20.391838 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2fbfd140-f2d3-4f75-8834-c00894b81517 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:20.428843 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-2fbfd140-f2d3-4f75-8834-c00894b81517 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] 10.222.0.79 "GET /compute/v2.1/servers/9f152f23-7594-4edf-b4f9-55a5e612e3b2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049860 Jan 28 02:10:20.433995 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 334/708] 10.222.0.79 () {58 vars in 1301 bytes} [Fri Jan 28 02:10:20 2022] GET /compute/v2.1/servers/9f152f23-7594-4edf-b4f9-55a5e612e3b2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:10:20.632867 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-8c4eb973-ddec-4a10-a490-f36a824a43c0 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:10:20.633464 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-8c4eb973-ddec-4a10-a490-f36a824a43c0 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] [instance: 9b886ef6-6c08-4ed8-9d10-35c49c2c6382] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:10:20.639153 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-8c4eb973-ddec-4a10-a490-f36a824a43c0 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:20.639595 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-8c4eb973-ddec-4a10-a490-f36a824a43c0 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:20.640386 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-8c4eb973-ddec-4a10-a490-f36a824a43c0 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:20.640846 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-8c4eb973-ddec-4a10-a490-f36a824a43c0 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:20.778344 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-8c4eb973-ddec-4a10-a490-f36a824a43c0 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5c39b83f31473696c9b249ab49d780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55dde8892fa47bd9941bb1ce9aa3673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:10:20.786815 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-8c4eb973-ddec-4a10-a490-f36a824a43c0 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] 10.222.0.79 "GET /compute/v2.1/servers/9b886ef6-6c08-4ed8-9d10-35c49c2c6382" status: 200 len: 1259 microversion: 2.1 time: 0.157700 Jan 28 02:10:20.787800 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 375/709] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:10:20 2022] GET /compute/v2.1/servers/9b886ef6-6c08-4ed8-9d10-35c49c2c6382 => generated 1259 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:10:21.077560 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [req-4cb9d508-d14f-4007-bd79-4feeb7f687ed req-3c7fa681-9995-4764-81af-e43225763401 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b886ef6-6c08-4ed8-9d10-35c49c2c6382", "name": "network-vif-plugged", "status": "completed", "tag": "7b4575d4-25de-48a0-8c88-24340312c99a"}]} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:10:21.081750 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:10:21.081750 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: warnings.warn(msg) Jan 28 02:10:21.090059 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-4cb9d508-d14f-4007-bd79-4feeb7f687ed req-3c7fa681-9995-4764-81af-e43225763401 service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:21.090500 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-4cb9d508-d14f-4007-bd79-4feeb7f687ed req-3c7fa681-9995-4764-81af-e43225763401 service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:21.101972 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.compute.server_external_events [req-4cb9d508-d14f-4007-bd79-4feeb7f687ed req-3c7fa681-9995-4764-81af-e43225763401 service nova] Creating event network-vif-plugged:7b4575d4-25de-48a0-8c88-24340312c99a for instance 9b886ef6-6c08-4ed8-9d10-35c49c2c6382 on hv-cinder-82497 Jan 28 02:10:21.106760 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [req-4cb9d508-d14f-4007-bd79-4feeb7f687ed req-3c7fa681-9995-4764-81af-e43225763401 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035212 Jan 28 02:10:21.107397 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 335/710] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Jan 28 02:10:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:10:21.439790 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-e7bd13d0-db57-4203-a999-982d3e47d95d tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:10:21.440896 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-e7bd13d0-db57-4203-a999-982d3e47d95d tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] [instance: 9f152f23-7594-4edf-b4f9-55a5e612e3b2] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:10:21.446812 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-e7bd13d0-db57-4203-a999-982d3e47d95d tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:21.447194 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-e7bd13d0-db57-4203-a999-982d3e47d95d tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:21.447952 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-e7bd13d0-db57-4203-a999-982d3e47d95d tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:21.448413 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-e7bd13d0-db57-4203-a999-982d3e47d95d tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:21.479304 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-e7bd13d0-db57-4203-a999-982d3e47d95d tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] 10.222.0.79 "GET /compute/v2.1/servers/9f152f23-7594-4edf-b4f9-55a5e612e3b2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043591 Jan 28 02:10:21.479937 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 376/711] 10.222.0.79 () {58 vars in 1301 bytes} [Fri Jan 28 02:10:21 2022] GET /compute/v2.1/servers/9f152f23-7594-4edf-b4f9-55a5e612e3b2/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 02:10:21.804981 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-a56f0d9a-d0e6-4f5a-9619-6c737b7236b3 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:10:21.805752 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-a56f0d9a-d0e6-4f5a-9619-6c737b7236b3 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] [instance: 9b886ef6-6c08-4ed8-9d10-35c49c2c6382] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:10:21.811739 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a56f0d9a-d0e6-4f5a-9619-6c737b7236b3 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:21.812210 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a56f0d9a-d0e6-4f5a-9619-6c737b7236b3 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:21.812969 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a56f0d9a-d0e6-4f5a-9619-6c737b7236b3 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:21.813506 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a56f0d9a-d0e6-4f5a-9619-6c737b7236b3 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:21.973085 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-a56f0d9a-d0e6-4f5a-9619-6c737b7236b3 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5c39b83f31473696c9b249ab49d780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55dde8892fa47bd9941bb1ce9aa3673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:10:21.980898 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-a56f0d9a-d0e6-4f5a-9619-6c737b7236b3 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] 10.222.0.79 "GET /compute/v2.1/servers/9b886ef6-6c08-4ed8-9d10-35c49c2c6382" status: 200 len: 1259 microversion: 2.1 time: 0.180176 Jan 28 02:10:21.981516 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 336/712] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:10:21 2022] GET /compute/v2.1/servers/9b886ef6-6c08-4ed8-9d10-35c49c2c6382 => generated 1259 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:10:22.917506 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-4cc5637b-7343-4b69-a311-2fed802e9135 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:10:22.917991 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-4cc5637b-7343-4b69-a311-2fed802e9135 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] [instance: 9f152f23-7594-4edf-b4f9-55a5e612e3b2] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:10:22.924823 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-4cc5637b-7343-4b69-a311-2fed802e9135 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:22.925302 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-4cc5637b-7343-4b69-a311-2fed802e9135 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:22.926072 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-4cc5637b-7343-4b69-a311-2fed802e9135 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:22.926516 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-4cc5637b-7343-4b69-a311-2fed802e9135 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:22.950780 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-4cc5637b-7343-4b69-a311-2fed802e9135 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] [instance: 9f152f23-7594-4edf-b4f9-55a5e612e3b2] Going to try to terminate instance {{(pid=116374) delete /opt/stack/nova/nova/compute/api.py:2612}} Jan 28 02:10:22.997348 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-f97db0ec-283a-4355-9fe1-b2cc9204ae4e tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:10:22.998009 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-f97db0ec-283a-4355-9fe1-b2cc9204ae4e tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] [instance: 9b886ef6-6c08-4ed8-9d10-35c49c2c6382] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:10:23.004607 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f97db0ec-283a-4355-9fe1-b2cc9204ae4e tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:23.005082 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f97db0ec-283a-4355-9fe1-b2cc9204ae4e tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:23.005899 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f97db0ec-283a-4355-9fe1-b2cc9204ae4e tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:23.006353 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f97db0ec-283a-4355-9fe1-b2cc9204ae4e tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:23.145829 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-f97db0ec-283a-4355-9fe1-b2cc9204ae4e tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5c39b83f31473696c9b249ab49d780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55dde8892fa47bd9941bb1ce9aa3673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:10:23.158450 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-f97db0ec-283a-4355-9fe1-b2cc9204ae4e tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] 10.222.0.79 "GET /compute/v2.1/servers/9b886ef6-6c08-4ed8-9d10-35c49c2c6382" status: 200 len: 1259 microversion: 2.1 time: 0.164290 Jan 28 02:10:23.159757 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 337/713] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:10:22 2022] GET /compute/v2.1/servers/9b886ef6-6c08-4ed8-9d10-35c49c2c6382 => generated 1259 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:10:23.424958 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-4cc5637b-7343-4b69-a311-2fed802e9135 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] 10.222.0.79 "DELETE /compute/v2.1/servers/9f152f23-7594-4edf-b4f9-55a5e612e3b2" status: 204 len: 0 microversion: 2.1 time: 0.509371 Jan 28 02:10:23.426040 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 377/714] 10.222.0.79 () {58 vars in 1238 bytes} [Fri Jan 28 02:10:22 2022] DELETE /compute/v2.1/servers/9f152f23-7594-4edf-b4f9-55a5e612e3b2 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 28 02:10:23.435521 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-62399316-71eb-4bdd-a5bd-9425a7348d13 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:10:23.436187 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-62399316-71eb-4bdd-a5bd-9425a7348d13 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] [instance: 9f152f23-7594-4edf-b4f9-55a5e612e3b2] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:10:23.443167 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-62399316-71eb-4bdd-a5bd-9425a7348d13 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:23.443611 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-62399316-71eb-4bdd-a5bd-9425a7348d13 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:23.444645 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-62399316-71eb-4bdd-a5bd-9425a7348d13 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:23.445118 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-62399316-71eb-4bdd-a5bd-9425a7348d13 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:23.566329 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-62399316-71eb-4bdd-a5bd-9425a7348d13 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b019715a14074e059730965913694e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b66ddee4c864aae90b738695dffbeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:10:23.573704 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-62399316-71eb-4bdd-a5bd-9425a7348d13 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] 10.222.0.79 "GET /compute/v2.1/servers/9f152f23-7594-4edf-b4f9-55a5e612e3b2" status: 200 len: 1513 microversion: 2.1 time: 0.141934 Jan 28 02:10:23.574282 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 338/715] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:10:23 2022] GET /compute/v2.1/servers/9f152f23-7594-4edf-b4f9-55a5e612e3b2 => generated 1513 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:10:24.176433 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-2e53b629-7ab9-431a-a257-b9b617bd3c39 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:10:24.177910 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-2e53b629-7ab9-431a-a257-b9b617bd3c39 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] [instance: 9b886ef6-6c08-4ed8-9d10-35c49c2c6382] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:10:24.183165 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-2e53b629-7ab9-431a-a257-b9b617bd3c39 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:24.183610 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-2e53b629-7ab9-431a-a257-b9b617bd3c39 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:24.184403 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-2e53b629-7ab9-431a-a257-b9b617bd3c39 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:24.184834 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-2e53b629-7ab9-431a-a257-b9b617bd3c39 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:24.327295 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-2e53b629-7ab9-431a-a257-b9b617bd3c39 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5c39b83f31473696c9b249ab49d780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55dde8892fa47bd9941bb1ce9aa3673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:10:24.335467 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-2e53b629-7ab9-431a-a257-b9b617bd3c39 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] 10.222.0.79 "GET /compute/v2.1/servers/9b886ef6-6c08-4ed8-9d10-35c49c2c6382" status: 200 len: 1443 microversion: 2.1 time: 0.163021 Jan 28 02:10:24.336078 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 378/716] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:10:24 2022] GET /compute/v2.1/servers/9b886ef6-6c08-4ed8-9d10-35c49c2c6382 => generated 1443 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:10:24.354769 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-a5208884-597d-4896-8233-fc144ac7e090 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:10:24.355412 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-a5208884-597d-4896-8233-fc144ac7e090 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] [instance: 9b886ef6-6c08-4ed8-9d10-35c49c2c6382] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:10:24.362575 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a5208884-597d-4896-8233-fc144ac7e090 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:24.363042 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a5208884-597d-4896-8233-fc144ac7e090 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:24.363851 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a5208884-597d-4896-8233-fc144ac7e090 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:24.364326 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a5208884-597d-4896-8233-fc144ac7e090 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:24.495826 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-a5208884-597d-4896-8233-fc144ac7e090 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5c39b83f31473696c9b249ab49d780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55dde8892fa47bd9941bb1ce9aa3673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:10:24.504172 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-a5208884-597d-4896-8233-fc144ac7e090 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] 10.222.0.79 "GET /compute/v2.1/servers/9b886ef6-6c08-4ed8-9d10-35c49c2c6382" status: 200 len: 1443 microversion: 2.1 time: 0.152982 Jan 28 02:10:24.504762 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 339/717] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:10:24 2022] GET /compute/v2.1/servers/9b886ef6-6c08-4ed8-9d10-35c49c2c6382 => generated 1443 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:10:24.593155 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-4ea75572-23cd-4f20-8588-9b802200b9e2 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:10:24.593977 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-4ea75572-23cd-4f20-8588-9b802200b9e2 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] [instance: 9f152f23-7594-4edf-b4f9-55a5e612e3b2] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:10:24.600629 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-4ea75572-23cd-4f20-8588-9b802200b9e2 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:24.601095 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-4ea75572-23cd-4f20-8588-9b802200b9e2 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:24.602035 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-4ea75572-23cd-4f20-8588-9b802200b9e2 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:24.602621 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-4ea75572-23cd-4f20-8588-9b802200b9e2 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:24.759207 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-4ea75572-23cd-4f20-8588-9b802200b9e2 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b019715a14074e059730965913694e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b66ddee4c864aae90b738695dffbeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:10:24.768218 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-4ea75572-23cd-4f20-8588-9b802200b9e2 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] 10.222.0.79 "GET /compute/v2.1/servers/9f152f23-7594-4edf-b4f9-55a5e612e3b2" status: 200 len: 1513 microversion: 2.1 time: 0.179406 Jan 28 02:10:24.769207 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 379/718] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:10:24 2022] GET /compute/v2.1/servers/9f152f23-7594-4edf-b4f9-55a5e612e3b2 => generated 1513 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:10:25.786020 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-2c35f211-4ed5-45bd-89c1-7ec0283d0e6e tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:10:25.786625 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-2c35f211-4ed5-45bd-89c1-7ec0283d0e6e tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] [instance: 9f152f23-7594-4edf-b4f9-55a5e612e3b2] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:10:25.792696 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2c35f211-4ed5-45bd-89c1-7ec0283d0e6e tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:25.793149 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2c35f211-4ed5-45bd-89c1-7ec0283d0e6e tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:25.793916 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2c35f211-4ed5-45bd-89c1-7ec0283d0e6e tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:25.794346 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2c35f211-4ed5-45bd-89c1-7ec0283d0e6e tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:26.025900 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-2c35f211-4ed5-45bd-89c1-7ec0283d0e6e tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b019715a14074e059730965913694e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b66ddee4c864aae90b738695dffbeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:10:26.039802 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-2c35f211-4ed5-45bd-89c1-7ec0283d0e6e tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] 10.222.0.79 "GET /compute/v2.1/servers/9f152f23-7594-4edf-b4f9-55a5e612e3b2" status: 200 len: 1513 microversion: 2.1 time: 0.258285 Jan 28 02:10:26.040422 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 340/719] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:10:25 2022] GET /compute/v2.1/servers/9f152f23-7594-4edf-b4f9-55a5e612e3b2 => generated 1513 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:10:26.625387 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [req-b561ba62-6c48-4a03-975f-ca648f87a772 req-836fcae3-b049-4829-9b67-2e7c80c0ab52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f152f23-7594-4edf-b4f9-55a5e612e3b2", "name": "network-vif-deleted", "tag": "c5c39784-9c84-4033-af10-4d23893a7023"}]} {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:10:26.627363 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:10:26.627363 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: warnings.warn(msg) Jan 28 02:10:26.634653 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [req-b561ba62-6c48-4a03-975f-ca648f87a772 req-836fcae3-b049-4829-9b67-2e7c80c0ab52 service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:26.639576 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [req-b561ba62-6c48-4a03-975f-ca648f87a772 req-836fcae3-b049-4829-9b67-2e7c80c0ab52 service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:26.646602 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.compute.server_external_events [req-b561ba62-6c48-4a03-975f-ca648f87a772 req-836fcae3-b049-4829-9b67-2e7c80c0ab52 service nova] Creating event network-vif-deleted:c5c39784-9c84-4033-af10-4d23893a7023 for instance 9f152f23-7594-4edf-b4f9-55a5e612e3b2 on hv-cinder-82497 Jan 28 02:10:26.651487 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [req-b561ba62-6c48-4a03-975f-ca648f87a772 req-836fcae3-b049-4829-9b67-2e7c80c0ab52 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029694 Jan 28 02:10:26.652200 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 380/720] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Jan 28 02:10:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:10:27.057261 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-9f1b60a1-1e52-4838-90d4-53369e779ca9 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:10:27.057882 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-9f1b60a1-1e52-4838-90d4-53369e779ca9 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] [instance: 9f152f23-7594-4edf-b4f9-55a5e612e3b2] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:10:27.064828 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-9f1b60a1-1e52-4838-90d4-53369e779ca9 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:27.065291 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-9f1b60a1-1e52-4838-90d4-53369e779ca9 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:27.066112 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-9f1b60a1-1e52-4838-90d4-53369e779ca9 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:27.066556 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-9f1b60a1-1e52-4838-90d4-53369e779ca9 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:27.099385 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-9f1b60a1-1e52-4838-90d4-53369e779ca9 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:27.099735 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-9f1b60a1-1e52-4838-90d4-53369e779ca9 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:27.100237 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.objects.instance [None req-9f1b60a1-1e52-4838-90d4-53369e779ca9 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lazy-loading 'fault' on Instance uuid 9f152f23-7594-4edf-b4f9-55a5e612e3b2 {{(pid=116375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jan 28 02:10:27.173596 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-9f1b60a1-1e52-4838-90d4-53369e779ca9 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b019715a14074e059730965913694e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b66ddee4c864aae90b738695dffbeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:10:27.183565 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-9f1b60a1-1e52-4838-90d4-53369e779ca9 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] 10.222.0.79 "GET /compute/v2.1/servers/9f152f23-7594-4edf-b4f9-55a5e612e3b2" status: 200 len: 1307 microversion: 2.1 time: 0.130330 Jan 28 02:10:27.184358 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 341/721] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:10:27 2022] GET /compute/v2.1/servers/9f152f23-7594-4edf-b4f9-55a5e612e3b2 => generated 1307 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:10:27.913290 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-54f703d9-9536-4ddc-abb9-c5e9117a4253 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:10:27.914462 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-54f703d9-9536-4ddc-abb9-c5e9117a4253 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] [instance: 086c6296-168f-46fc-9ec4-8700b7c6ca9f] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:10:27.920892 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-54f703d9-9536-4ddc-abb9-c5e9117a4253 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:27.921357 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-54f703d9-9536-4ddc-abb9-c5e9117a4253 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:27.922258 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-54f703d9-9536-4ddc-abb9-c5e9117a4253 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:27.922762 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-54f703d9-9536-4ddc-abb9-c5e9117a4253 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:28.200930 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-086377e0-9b1e-4fc4-84fc-cd9a07edf65e tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:10:28.207477 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-086377e0-9b1e-4fc4-84fc-cd9a07edf65e tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] [instance: 9f152f23-7594-4edf-b4f9-55a5e612e3b2] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:10:28.232870 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-086377e0-9b1e-4fc4-84fc-cd9a07edf65e tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:28.232870 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-086377e0-9b1e-4fc4-84fc-cd9a07edf65e tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:28.232870 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-086377e0-9b1e-4fc4-84fc-cd9a07edf65e tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:28.232870 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-086377e0-9b1e-4fc4-84fc-cd9a07edf65e tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:28.234390 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.wsgi [None req-086377e0-9b1e-4fc4-84fc-cd9a07edf65e tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] HTTP exception thrown: Instance 9f152f23-7594-4edf-b4f9-55a5e612e3b2 could not be found. Jan 28 02:10:28.234390 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-086377e0-9b1e-4fc4-84fc-cd9a07edf65e tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Returning 404 to user: Instance 9f152f23-7594-4edf-b4f9-55a5e612e3b2 could not be found. {{(pid=116375) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 02:10:28.235109 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-086377e0-9b1e-4fc4-84fc-cd9a07edf65e tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] 10.222.0.79 "GET /compute/v2.1/servers/9f152f23-7594-4edf-b4f9-55a5e612e3b2" status: 404 len: 111 microversion: 2.1 time: 0.035658 Jan 28 02:10:28.236621 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 342/722] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:10:28 2022] GET /compute/v2.1/servers/9f152f23-7594-4edf-b4f9-55a5e612e3b2 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 02:10:28.410840 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-54f703d9-9536-4ddc-abb9-c5e9117a4253 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] 10.222.0.79 "POST /compute/v2.1/servers/086c6296-168f-46fc-9ec4-8700b7c6ca9f/action" status: 202 len: 0 microversion: 2.1 time: 0.501768 Jan 28 02:10:28.411548 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 381/723] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Jan 28 02:10:27 2022] POST /compute/v2.1/servers/086c6296-168f-46fc-9ec4-8700b7c6ca9f/action => generated 0 bytes in 504 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:10:28.421145 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-bf8c6e11-b485-4a54-8ff6-0e347391173a tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:10:28.421746 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-bf8c6e11-b485-4a54-8ff6-0e347391173a tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] [instance: 086c6296-168f-46fc-9ec4-8700b7c6ca9f] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:10:28.429714 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-bf8c6e11-b485-4a54-8ff6-0e347391173a tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:28.430161 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-bf8c6e11-b485-4a54-8ff6-0e347391173a tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:28.430945 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-bf8c6e11-b485-4a54-8ff6-0e347391173a tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:28.431405 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-bf8c6e11-b485-4a54-8ff6-0e347391173a tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:28.627673 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-bf8c6e11-b485-4a54-8ff6-0e347391173a tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14f6f890deb74eadab6b1ff4b6431036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e991e35dc5b463fbf9f08db0e72cf46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:10:28.639507 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-bf8c6e11-b485-4a54-8ff6-0e347391173a tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] 10.222.0.79 "GET /compute/v2.1/servers/086c6296-168f-46fc-9ec4-8700b7c6ca9f" status: 200 len: 1750 microversion: 2.1 time: 0.221928 Jan 28 02:10:28.650892 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 343/724] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:10:28 2022] GET /compute/v2.1/servers/086c6296-168f-46fc-9ec4-8700b7c6ca9f => generated 1750 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:10:28.677079 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [req-23554458-933a-49d0-a37d-316a3f584804 req-e549a6d9-e038-403e-b6f0-0416a434a98d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b886ef6-6c08-4ed8-9d10-35c49c2c6382", "tag": "7b4575d4-25de-48a0-8c88-24340312c99a"}]} {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:10:28.680920 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:10:28.680920 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: warnings.warn(msg) Jan 28 02:10:28.689885 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [req-23554458-933a-49d0-a37d-316a3f584804 req-e549a6d9-e038-403e-b6f0-0416a434a98d service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:28.690323 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [req-23554458-933a-49d0-a37d-316a3f584804 req-e549a6d9-e038-403e-b6f0-0416a434a98d service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:28.716481 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.compute.server_external_events [req-23554458-933a-49d0-a37d-316a3f584804 req-e549a6d9-e038-403e-b6f0-0416a434a98d service nova] Creating event network-changed:7b4575d4-25de-48a0-8c88-24340312c99a for instance 9b886ef6-6c08-4ed8-9d10-35c49c2c6382 on hv-cinder-82497 Jan 28 02:10:28.725045 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [req-23554458-933a-49d0-a37d-316a3f584804 req-e549a6d9-e038-403e-b6f0-0416a434a98d service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052180 Jan 28 02:10:28.725913 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 382/725] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Jan 28 02:10:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:10:29.658638 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-08d500b3-0409-4c57-ac8e-3bd532f247b2 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:10:29.659579 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-08d500b3-0409-4c57-ac8e-3bd532f247b2 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] [instance: 086c6296-168f-46fc-9ec4-8700b7c6ca9f] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:10:29.668123 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-08d500b3-0409-4c57-ac8e-3bd532f247b2 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:29.668590 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-08d500b3-0409-4c57-ac8e-3bd532f247b2 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:29.669483 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-08d500b3-0409-4c57-ac8e-3bd532f247b2 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:29.670029 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-08d500b3-0409-4c57-ac8e-3bd532f247b2 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:29.811760 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-08d500b3-0409-4c57-ac8e-3bd532f247b2 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14f6f890deb74eadab6b1ff4b6431036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e991e35dc5b463fbf9f08db0e72cf46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:10:29.820077 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-08d500b3-0409-4c57-ac8e-3bd532f247b2 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] 10.222.0.79 "GET /compute/v2.1/servers/086c6296-168f-46fc-9ec4-8700b7c6ca9f" status: 200 len: 1750 microversion: 2.1 time: 0.166073 Jan 28 02:10:29.820923 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 344/726] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:10:29 2022] GET /compute/v2.1/servers/086c6296-168f-46fc-9ec4-8700b7c6ca9f => generated 1750 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:10:29.828320 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-f3c00bb9-c020-479d-85fc-b59ff5f2858f tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:10:29.828959 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-f3c00bb9-c020-479d-85fc-b59ff5f2858f tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] [instance: 96b38440-c5bd-4838-bd1b-46312012607e] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:10:29.835707 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-f3c00bb9-c020-479d-85fc-b59ff5f2858f tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:29.836189 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-f3c00bb9-c020-479d-85fc-b59ff5f2858f tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:29.836953 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-f3c00bb9-c020-479d-85fc-b59ff5f2858f tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:29.837388 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-f3c00bb9-c020-479d-85fc-b59ff5f2858f tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:29.869847 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-f3c00bb9-c020-479d-85fc-b59ff5f2858f tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] [instance: 96b38440-c5bd-4838-bd1b-46312012607e] Going to try to terminate instance {{(pid=116374) delete /opt/stack/nova/nova/compute/api.py:2612}} Jan 28 02:10:30.218308 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-f3c00bb9-c020-479d-85fc-b59ff5f2858f tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] 10.222.0.79 "DELETE /compute/v2.1/servers/96b38440-c5bd-4838-bd1b-46312012607e" status: 204 len: 0 microversion: 2.1 time: 0.393763 Jan 28 02:10:30.218830 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 383/727] 10.222.0.79 () {58 vars in 1238 bytes} [Fri Jan 28 02:10:29 2022] DELETE /compute/v2.1/servers/96b38440-c5bd-4838-bd1b-46312012607e => generated 0 bytes in 395 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 28 02:10:30.227439 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-3c340627-97c8-49f2-a5bd-24e6d94c0b16 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:10:30.228072 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-3c340627-97c8-49f2-a5bd-24e6d94c0b16 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] [instance: 96b38440-c5bd-4838-bd1b-46312012607e] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:10:30.233832 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-3c340627-97c8-49f2-a5bd-24e6d94c0b16 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:30.234275 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-3c340627-97c8-49f2-a5bd-24e6d94c0b16 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:30.235031 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-3c340627-97c8-49f2-a5bd-24e6d94c0b16 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:30.235621 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-3c340627-97c8-49f2-a5bd-24e6d94c0b16 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:30.357471 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-3c340627-97c8-49f2-a5bd-24e6d94c0b16 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b019715a14074e059730965913694e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b66ddee4c864aae90b738695dffbeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:10:30.366893 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-3c340627-97c8-49f2-a5bd-24e6d94c0b16 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] 10.222.0.79 "GET /compute/v2.1/servers/96b38440-c5bd-4838-bd1b-46312012607e" status: 200 len: 1515 microversion: 2.1 time: 0.142943 Jan 28 02:10:30.367486 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 345/728] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:10:30 2022] GET /compute/v2.1/servers/96b38440-c5bd-4838-bd1b-46312012607e => generated 1515 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:10:30.840528 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-6af28bcd-837c-4557-9c44-ba088daf7d0d tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:10:30.841415 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-6af28bcd-837c-4557-9c44-ba088daf7d0d tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] [instance: 086c6296-168f-46fc-9ec4-8700b7c6ca9f] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:10:30.848094 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-6af28bcd-837c-4557-9c44-ba088daf7d0d tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:30.848646 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-6af28bcd-837c-4557-9c44-ba088daf7d0d tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:30.849426 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-6af28bcd-837c-4557-9c44-ba088daf7d0d tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:30.849858 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-6af28bcd-837c-4557-9c44-ba088daf7d0d tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:30.973821 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-6af28bcd-837c-4557-9c44-ba088daf7d0d tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14f6f890deb74eadab6b1ff4b6431036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e991e35dc5b463fbf9f08db0e72cf46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:10:30.981619 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-6af28bcd-837c-4557-9c44-ba088daf7d0d tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] 10.222.0.79 "GET /compute/v2.1/servers/086c6296-168f-46fc-9ec4-8700b7c6ca9f" status: 200 len: 1755 microversion: 2.1 time: 0.146581 Jan 28 02:10:30.982190 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 384/729] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:10:30 2022] GET /compute/v2.1/servers/086c6296-168f-46fc-9ec4-8700b7c6ca9f => generated 1755 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:10:31.388658 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-0a0777f5-2f0b-43b8-99eb-1ed164b5eed1 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:10:31.389154 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-0a0777f5-2f0b-43b8-99eb-1ed164b5eed1 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] [instance: 96b38440-c5bd-4838-bd1b-46312012607e] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:10:31.395753 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-0a0777f5-2f0b-43b8-99eb-1ed164b5eed1 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:31.396314 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-0a0777f5-2f0b-43b8-99eb-1ed164b5eed1 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:31.396972 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-0a0777f5-2f0b-43b8-99eb-1ed164b5eed1 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:31.397392 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-0a0777f5-2f0b-43b8-99eb-1ed164b5eed1 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:31.517715 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-0a0777f5-2f0b-43b8-99eb-1ed164b5eed1 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b019715a14074e059730965913694e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b66ddee4c864aae90b738695dffbeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:10:31.525190 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-0a0777f5-2f0b-43b8-99eb-1ed164b5eed1 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] 10.222.0.79 "GET /compute/v2.1/servers/96b38440-c5bd-4838-bd1b-46312012607e" status: 200 len: 1515 microversion: 2.1 time: 0.140282 Jan 28 02:10:31.525760 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 346/730] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:10:31 2022] GET /compute/v2.1/servers/96b38440-c5bd-4838-bd1b-46312012607e => generated 1515 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:10:31.999335 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-d87c1479-b2bd-4837-b066-433cffea9b10 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:10:31.999935 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-d87c1479-b2bd-4837-b066-433cffea9b10 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] [instance: 086c6296-168f-46fc-9ec4-8700b7c6ca9f] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:10:32.006459 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-d87c1479-b2bd-4837-b066-433cffea9b10 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:32.006904 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-d87c1479-b2bd-4837-b066-433cffea9b10 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:32.007696 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-d87c1479-b2bd-4837-b066-433cffea9b10 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:32.008157 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-d87c1479-b2bd-4837-b066-433cffea9b10 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:32.134707 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-d87c1479-b2bd-4837-b066-433cffea9b10 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14f6f890deb74eadab6b1ff4b6431036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e991e35dc5b463fbf9f08db0e72cf46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:10:32.153660 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-d87c1479-b2bd-4837-b066-433cffea9b10 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] 10.222.0.79 "GET /compute/v2.1/servers/086c6296-168f-46fc-9ec4-8700b7c6ca9f" status: 200 len: 1755 microversion: 2.1 time: 0.157774 Jan 28 02:10:32.154376 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 385/731] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:10:31 2022] GET /compute/v2.1/servers/086c6296-168f-46fc-9ec4-8700b7c6ca9f => generated 1755 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:10:32.542510 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-89946426-686e-4f97-8251-5c23e0c305c0 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:10:32.543293 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-89946426-686e-4f97-8251-5c23e0c305c0 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] [instance: 96b38440-c5bd-4838-bd1b-46312012607e] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:10:32.549752 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-89946426-686e-4f97-8251-5c23e0c305c0 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:32.550189 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-89946426-686e-4f97-8251-5c23e0c305c0 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:32.551538 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-89946426-686e-4f97-8251-5c23e0c305c0 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:32.552192 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-89946426-686e-4f97-8251-5c23e0c305c0 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:32.760503 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-89946426-686e-4f97-8251-5c23e0c305c0 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b019715a14074e059730965913694e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b66ddee4c864aae90b738695dffbeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:10:32.769892 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-89946426-686e-4f97-8251-5c23e0c305c0 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] 10.222.0.79 "GET /compute/v2.1/servers/96b38440-c5bd-4838-bd1b-46312012607e" status: 200 len: 1515 microversion: 2.1 time: 0.231239 Jan 28 02:10:32.770569 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 347/732] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:10:32 2022] GET /compute/v2.1/servers/96b38440-c5bd-4838-bd1b-46312012607e => generated 1515 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:10:33.015293 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [req-981bb297-730d-4bdd-bc45-a7ac6142d1e8 req-b836e3f3-b786-475c-b7cc-55199194557c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96b38440-c5bd-4838-bd1b-46312012607e", "name": "network-vif-deleted", "tag": "8d7133bd-248c-438b-adfd-1ef3f2765032"}]} {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:10:33.017095 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:10:33.017095 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: warnings.warn(msg) Jan 28 02:10:33.023924 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [req-981bb297-730d-4bdd-bc45-a7ac6142d1e8 req-b836e3f3-b786-475c-b7cc-55199194557c service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:33.024398 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [req-981bb297-730d-4bdd-bc45-a7ac6142d1e8 req-b836e3f3-b786-475c-b7cc-55199194557c service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:33.035326 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.compute.server_external_events [req-981bb297-730d-4bdd-bc45-a7ac6142d1e8 req-b836e3f3-b786-475c-b7cc-55199194557c service nova] Creating event network-vif-deleted:8d7133bd-248c-438b-adfd-1ef3f2765032 for instance 96b38440-c5bd-4838-bd1b-46312012607e on hv-cinder-82497 Jan 28 02:10:33.040323 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [req-981bb297-730d-4bdd-bc45-a7ac6142d1e8 req-b836e3f3-b786-475c-b7cc-55199194557c service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028535 Jan 28 02:10:33.040978 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 386/733] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Jan 28 02:10:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 02:10:33.171020 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-764198d5-d80e-4767-851c-1677b444cb94 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:10:33.171214 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-764198d5-d80e-4767-851c-1677b444cb94 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] [instance: 086c6296-168f-46fc-9ec4-8700b7c6ca9f] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:10:33.181359 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-764198d5-d80e-4767-851c-1677b444cb94 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:33.181892 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-764198d5-d80e-4767-851c-1677b444cb94 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:33.183279 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-764198d5-d80e-4767-851c-1677b444cb94 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:33.183887 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-764198d5-d80e-4767-851c-1677b444cb94 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:33.310103 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-764198d5-d80e-4767-851c-1677b444cb94 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14f6f890deb74eadab6b1ff4b6431036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e991e35dc5b463fbf9f08db0e72cf46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:10:33.318975 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-764198d5-d80e-4767-851c-1677b444cb94 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] 10.222.0.79 "GET /compute/v2.1/servers/086c6296-168f-46fc-9ec4-8700b7c6ca9f" status: 200 len: 1755 microversion: 2.1 time: 0.152266 Jan 28 02:10:33.319552 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 348/734] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:10:33 2022] GET /compute/v2.1/servers/086c6296-168f-46fc-9ec4-8700b7c6ca9f => generated 1755 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:10:33.787765 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-667c580f-a847-4767-84db-c4ff23f3c9f3 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:10:33.788390 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-667c580f-a847-4767-84db-c4ff23f3c9f3 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] [instance: 96b38440-c5bd-4838-bd1b-46312012607e] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:10:33.794413 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-667c580f-a847-4767-84db-c4ff23f3c9f3 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:33.794852 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-667c580f-a847-4767-84db-c4ff23f3c9f3 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:33.795643 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-667c580f-a847-4767-84db-c4ff23f3c9f3 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:33.796263 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-667c580f-a847-4767-84db-c4ff23f3c9f3 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:33.827520 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-667c580f-a847-4767-84db-c4ff23f3c9f3 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:33.828079 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-667c580f-a847-4767-84db-c4ff23f3c9f3 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:33.834284 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.objects.instance [None req-667c580f-a847-4767-84db-c4ff23f3c9f3 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lazy-loading 'fault' on Instance uuid 96b38440-c5bd-4838-bd1b-46312012607e {{(pid=116374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jan 28 02:10:33.872565 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-667c580f-a847-4767-84db-c4ff23f3c9f3 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b019715a14074e059730965913694e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b66ddee4c864aae90b738695dffbeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:10:33.880162 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-667c580f-a847-4767-84db-c4ff23f3c9f3 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] 10.222.0.79 "GET /compute/v2.1/servers/96b38440-c5bd-4838-bd1b-46312012607e" status: 200 len: 1308 microversion: 2.1 time: 0.097046 Jan 28 02:10:33.880930 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 387/735] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:10:33 2022] GET /compute/v2.1/servers/96b38440-c5bd-4838-bd1b-46312012607e => generated 1308 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:10:34.336066 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-15dccc18-66b6-4746-ab46-6d226644920f tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:10:34.336670 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-15dccc18-66b6-4746-ab46-6d226644920f tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] [instance: 086c6296-168f-46fc-9ec4-8700b7c6ca9f] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:10:34.342281 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-15dccc18-66b6-4746-ab46-6d226644920f tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:34.342712 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-15dccc18-66b6-4746-ab46-6d226644920f tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:34.343456 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-15dccc18-66b6-4746-ab46-6d226644920f tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:34.343874 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-15dccc18-66b6-4746-ab46-6d226644920f tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:34.471879 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-15dccc18-66b6-4746-ab46-6d226644920f tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14f6f890deb74eadab6b1ff4b6431036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e991e35dc5b463fbf9f08db0e72cf46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:10:34.479905 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-15dccc18-66b6-4746-ab46-6d226644920f tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] 10.222.0.79 "GET /compute/v2.1/servers/086c6296-168f-46fc-9ec4-8700b7c6ca9f" status: 200 len: 1755 microversion: 2.1 time: 0.147647 Jan 28 02:10:34.480512 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 349/736] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:10:34 2022] GET /compute/v2.1/servers/086c6296-168f-46fc-9ec4-8700b7c6ca9f => generated 1755 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:10:34.902345 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-41fffcf4-3c5e-41da-ba3c-707c151c6c8f tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:10:34.902943 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-41fffcf4-3c5e-41da-ba3c-707c151c6c8f tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] [instance: 96b38440-c5bd-4838-bd1b-46312012607e] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:10:34.909901 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-41fffcf4-3c5e-41da-ba3c-707c151c6c8f tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:34.910356 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-41fffcf4-3c5e-41da-ba3c-707c151c6c8f tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:34.911135 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-41fffcf4-3c5e-41da-ba3c-707c151c6c8f tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:34.911664 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-41fffcf4-3c5e-41da-ba3c-707c151c6c8f tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:34.925690 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.wsgi [None req-41fffcf4-3c5e-41da-ba3c-707c151c6c8f tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] HTTP exception thrown: Instance 96b38440-c5bd-4838-bd1b-46312012607e could not be found. Jan 28 02:10:34.926281 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-41fffcf4-3c5e-41da-ba3c-707c151c6c8f tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Returning 404 to user: Instance 96b38440-c5bd-4838-bd1b-46312012607e could not be found. {{(pid=116374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 02:10:34.927115 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-41fffcf4-3c5e-41da-ba3c-707c151c6c8f tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] 10.222.0.79 "GET /compute/v2.1/servers/96b38440-c5bd-4838-bd1b-46312012607e" status: 404 len: 111 microversion: 2.1 time: 0.028770 Jan 28 02:10:34.927644 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 388/737] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:10:34 2022] GET /compute/v2.1/servers/96b38440-c5bd-4838-bd1b-46312012607e => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 02:10:34.935455 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-b4eabf0d-4e45-4ed4-866f-af180eb69088 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:10:34.936301 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-b4eabf0d-4e45-4ed4-866f-af180eb69088 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] [instance: f529663e-c976-44f4-b501-5c3469c86721] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:10:34.942135 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b4eabf0d-4e45-4ed4-866f-af180eb69088 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:34.942607 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b4eabf0d-4e45-4ed4-866f-af180eb69088 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:34.943413 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b4eabf0d-4e45-4ed4-866f-af180eb69088 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:34.943916 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b4eabf0d-4e45-4ed4-866f-af180eb69088 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:34.968443 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-b4eabf0d-4e45-4ed4-866f-af180eb69088 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] [instance: f529663e-c976-44f4-b501-5c3469c86721] Going to try to terminate instance {{(pid=116375) delete /opt/stack/nova/nova/compute/api.py:2612}} Jan 28 02:10:35.371680 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-b4eabf0d-4e45-4ed4-866f-af180eb69088 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] 10.222.0.79 "DELETE /compute/v2.1/servers/f529663e-c976-44f4-b501-5c3469c86721" status: 204 len: 0 microversion: 2.1 time: 0.439527 Jan 28 02:10:35.372423 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 350/738] 10.222.0.79 () {58 vars in 1238 bytes} [Fri Jan 28 02:10:34 2022] DELETE /compute/v2.1/servers/f529663e-c976-44f4-b501-5c3469c86721 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 28 02:10:35.380201 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-1b3aac8a-fcf0-472c-a007-5551b63586a0 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:10:35.380946 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-1b3aac8a-fcf0-472c-a007-5551b63586a0 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] [instance: f529663e-c976-44f4-b501-5c3469c86721] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:10:35.386655 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-1b3aac8a-fcf0-472c-a007-5551b63586a0 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:35.387093 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-1b3aac8a-fcf0-472c-a007-5551b63586a0 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:35.387843 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-1b3aac8a-fcf0-472c-a007-5551b63586a0 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:35.388291 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-1b3aac8a-fcf0-472c-a007-5551b63586a0 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:35.499400 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-4828b2a0-933f-41d6-a2e8-6105bb06cde5 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:10:35.500483 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-4828b2a0-933f-41d6-a2e8-6105bb06cde5 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] [instance: 086c6296-168f-46fc-9ec4-8700b7c6ca9f] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:10:35.515945 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-1b3aac8a-fcf0-472c-a007-5551b63586a0 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b019715a14074e059730965913694e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b66ddee4c864aae90b738695dffbeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:10:35.516248 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-4828b2a0-933f-41d6-a2e8-6105bb06cde5 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:35.516647 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-4828b2a0-933f-41d6-a2e8-6105bb06cde5 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:35.518338 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-4828b2a0-933f-41d6-a2e8-6105bb06cde5 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:35.518933 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-4828b2a0-933f-41d6-a2e8-6105bb06cde5 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:35.524927 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-1b3aac8a-fcf0-472c-a007-5551b63586a0 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] 10.222.0.79 "GET /compute/v2.1/servers/f529663e-c976-44f4-b501-5c3469c86721" status: 200 len: 1515 microversion: 2.1 time: 0.148485 Jan 28 02:10:35.525586 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 389/739] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:10:35 2022] GET /compute/v2.1/servers/f529663e-c976-44f4-b501-5c3469c86721 => generated 1515 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:10:35.647382 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-4828b2a0-933f-41d6-a2e8-6105bb06cde5 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14f6f890deb74eadab6b1ff4b6431036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e991e35dc5b463fbf9f08db0e72cf46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:10:35.655461 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-4828b2a0-933f-41d6-a2e8-6105bb06cde5 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] 10.222.0.79 "GET /compute/v2.1/servers/086c6296-168f-46fc-9ec4-8700b7c6ca9f" status: 200 len: 1755 microversion: 2.1 time: 0.160241 Jan 28 02:10:35.656148 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 351/740] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:10:35 2022] GET /compute/v2.1/servers/086c6296-168f-46fc-9ec4-8700b7c6ca9f => generated 1755 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:10:36.542583 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-aed46223-ee31-492d-95a2-22940d8edc13 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:10:36.543278 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-aed46223-ee31-492d-95a2-22940d8edc13 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] [instance: f529663e-c976-44f4-b501-5c3469c86721] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:10:36.550154 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-aed46223-ee31-492d-95a2-22940d8edc13 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:36.550699 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-aed46223-ee31-492d-95a2-22940d8edc13 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:36.551473 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-aed46223-ee31-492d-95a2-22940d8edc13 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:36.551911 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-aed46223-ee31-492d-95a2-22940d8edc13 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:36.672610 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-7f10aa04-6e80-475c-9432-208003467bfa tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:10:36.673255 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-7f10aa04-6e80-475c-9432-208003467bfa tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] [instance: 086c6296-168f-46fc-9ec4-8700b7c6ca9f] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:10:36.679116 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-7f10aa04-6e80-475c-9432-208003467bfa tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:36.679560 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-7f10aa04-6e80-475c-9432-208003467bfa tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:36.680358 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-7f10aa04-6e80-475c-9432-208003467bfa tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:36.680786 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-7f10aa04-6e80-475c-9432-208003467bfa tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:36.680960 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-aed46223-ee31-492d-95a2-22940d8edc13 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b019715a14074e059730965913694e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b66ddee4c864aae90b738695dffbeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:10:36.688504 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-aed46223-ee31-492d-95a2-22940d8edc13 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] 10.222.0.79 "GET /compute/v2.1/servers/f529663e-c976-44f4-b501-5c3469c86721" status: 200 len: 1515 microversion: 2.1 time: 0.149849 Jan 28 02:10:36.689064 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 390/741] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:10:36 2022] GET /compute/v2.1/servers/f529663e-c976-44f4-b501-5c3469c86721 => generated 1515 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:10:36.806056 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-7f10aa04-6e80-475c-9432-208003467bfa tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14f6f890deb74eadab6b1ff4b6431036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e991e35dc5b463fbf9f08db0e72cf46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:10:36.814007 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-7f10aa04-6e80-475c-9432-208003467bfa tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] 10.222.0.79 "GET /compute/v2.1/servers/086c6296-168f-46fc-9ec4-8700b7c6ca9f" status: 200 len: 1755 microversion: 2.1 time: 0.145014 Jan 28 02:10:36.814760 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 352/742] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:10:36 2022] GET /compute/v2.1/servers/086c6296-168f-46fc-9ec4-8700b7c6ca9f => generated 1755 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:10:37.705804 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-e5b398fc-d426-4058-868e-67ad033f7373 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:10:37.706407 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-e5b398fc-d426-4058-868e-67ad033f7373 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] [instance: f529663e-c976-44f4-b501-5c3469c86721] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:10:37.716059 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-e5b398fc-d426-4058-868e-67ad033f7373 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:37.716059 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-e5b398fc-d426-4058-868e-67ad033f7373 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:37.716059 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-e5b398fc-d426-4058-868e-67ad033f7373 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:37.716059 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-e5b398fc-d426-4058-868e-67ad033f7373 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:37.830674 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-af1d65be-32ba-49a3-8279-f3ee2720a440 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:10:37.831374 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-af1d65be-32ba-49a3-8279-f3ee2720a440 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] [instance: 086c6296-168f-46fc-9ec4-8700b7c6ca9f] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:10:37.837398 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-af1d65be-32ba-49a3-8279-f3ee2720a440 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:37.838134 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-af1d65be-32ba-49a3-8279-f3ee2720a440 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:37.838905 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-af1d65be-32ba-49a3-8279-f3ee2720a440 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:37.839345 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-af1d65be-32ba-49a3-8279-f3ee2720a440 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:37.920844 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-e5b398fc-d426-4058-868e-67ad033f7373 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b019715a14074e059730965913694e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b66ddee4c864aae90b738695dffbeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:10:37.930317 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-e5b398fc-d426-4058-868e-67ad033f7373 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] 10.222.0.79 "GET /compute/v2.1/servers/f529663e-c976-44f4-b501-5c3469c86721" status: 200 len: 1515 microversion: 2.1 time: 0.228557 Jan 28 02:10:37.931010 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 391/743] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:10:37 2022] GET /compute/v2.1/servers/f529663e-c976-44f4-b501-5c3469c86721 => generated 1515 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:10:37.936013 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [req-6ffd6f84-9ae6-4dde-9067-617aad606a6f req-3fd4639b-78e6-4e64-91ab-ad9ea7ffe030 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f529663e-c976-44f4-b501-5c3469c86721", "name": "network-vif-deleted", "tag": "a8128aba-f6b8-4d67-8aeb-48bca91f2e98"}]} {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:10:37.937649 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:10:37.937649 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: warnings.warn(msg) Jan 28 02:10:37.945268 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [req-6ffd6f84-9ae6-4dde-9067-617aad606a6f req-3fd4639b-78e6-4e64-91ab-ad9ea7ffe030 service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:37.945819 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [req-6ffd6f84-9ae6-4dde-9067-617aad606a6f req-3fd4639b-78e6-4e64-91ab-ad9ea7ffe030 service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:37.960634 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.compute.server_external_events [req-6ffd6f84-9ae6-4dde-9067-617aad606a6f req-3fd4639b-78e6-4e64-91ab-ad9ea7ffe030 service nova] Creating event network-vif-deleted:a8128aba-f6b8-4d67-8aeb-48bca91f2e98 for instance f529663e-c976-44f4-b501-5c3469c86721 on hv-cinder-82497 Jan 28 02:10:37.966729 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [req-6ffd6f84-9ae6-4dde-9067-617aad606a6f req-3fd4639b-78e6-4e64-91ab-ad9ea7ffe030 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034261 Jan 28 02:10:37.967821 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 392/744] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Jan 28 02:10:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:10:38.014912 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-af1d65be-32ba-49a3-8279-f3ee2720a440 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14f6f890deb74eadab6b1ff4b6431036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e991e35dc5b463fbf9f08db0e72cf46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:10:38.022937 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-af1d65be-32ba-49a3-8279-f3ee2720a440 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] 10.222.0.79 "GET /compute/v2.1/servers/086c6296-168f-46fc-9ec4-8700b7c6ca9f" status: 200 len: 1755 microversion: 2.1 time: 0.196103 Jan 28 02:10:38.023604 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 353/745] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:10:37 2022] GET /compute/v2.1/servers/086c6296-168f-46fc-9ec4-8700b7c6ca9f => generated 1755 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:10:38.947809 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-f2f9caac-34fb-4a20-93a4-61599aa1ea1e tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:10:38.948590 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-f2f9caac-34fb-4a20-93a4-61599aa1ea1e tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] [instance: f529663e-c976-44f4-b501-5c3469c86721] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:10:38.954642 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-f2f9caac-34fb-4a20-93a4-61599aa1ea1e tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:38.960602 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-f2f9caac-34fb-4a20-93a4-61599aa1ea1e tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:38.960602 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-f2f9caac-34fb-4a20-93a4-61599aa1ea1e tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:38.960602 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-f2f9caac-34fb-4a20-93a4-61599aa1ea1e tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:38.988267 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-f2f9caac-34fb-4a20-93a4-61599aa1ea1e tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:38.988788 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-f2f9caac-34fb-4a20-93a4-61599aa1ea1e tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:38.989142 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.objects.instance [None req-f2f9caac-34fb-4a20-93a4-61599aa1ea1e tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lazy-loading 'fault' on Instance uuid f529663e-c976-44f4-b501-5c3469c86721 {{(pid=116374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jan 28 02:10:39.030622 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-f2f9caac-34fb-4a20-93a4-61599aa1ea1e tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b019715a14074e059730965913694e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b66ddee4c864aae90b738695dffbeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:10:39.038384 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-f2f9caac-34fb-4a20-93a4-61599aa1ea1e tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] 10.222.0.79 "GET /compute/v2.1/servers/f529663e-c976-44f4-b501-5c3469c86721" status: 200 len: 1308 microversion: 2.1 time: 0.094718 Jan 28 02:10:39.038946 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 393/746] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:10:38 2022] GET /compute/v2.1/servers/f529663e-c976-44f4-b501-5c3469c86721 => generated 1308 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:10:39.041396 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-e00a9d59-fdcb-41a5-8c9c-4e4f756cd17d tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:10:39.042279 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-e00a9d59-fdcb-41a5-8c9c-4e4f756cd17d tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] [instance: 086c6296-168f-46fc-9ec4-8700b7c6ca9f] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:10:39.048395 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-e00a9d59-fdcb-41a5-8c9c-4e4f756cd17d tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:39.048844 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-e00a9d59-fdcb-41a5-8c9c-4e4f756cd17d tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:39.050626 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-e00a9d59-fdcb-41a5-8c9c-4e4f756cd17d tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:39.051429 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-e00a9d59-fdcb-41a5-8c9c-4e4f756cd17d tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:39.053605 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-f2047800-1eed-40f6-8e56-e406855a529f tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:10:39.054280 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-f2047800-1eed-40f6-8e56-e406855a529f tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:10:39.060039 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-f2047800-1eed-40f6-8e56-e406855a529f tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:39.060479 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-f2047800-1eed-40f6-8e56-e406855a529f tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:39.061239 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-f2047800-1eed-40f6-8e56-e406855a529f tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:39.061665 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-f2047800-1eed-40f6-8e56-e406855a529f tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:39.091874 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-f2047800-1eed-40f6-8e56-e406855a529f tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84/os-volume_attachments/dac4f435-89c0-430b-8eb7-66be785cbcbe" status: 200 len: 194 microversion: 2.20 time: 0.042630 Jan 28 02:10:39.092523 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 394/747] 10.222.0.79 () {60 vars in 1453 bytes} [Fri Jan 28 02:10:39 2022] GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84/os-volume_attachments/dac4f435-89c0-430b-8eb7-66be785cbcbe => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 02:10:39.164184 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-e5e49c9f-95eb-4029-9f9f-e5b077d3b42f tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:10:39.165138 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-e5e49c9f-95eb-4029-9f9f-e5b077d3b42f tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:10:39.171366 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-e5e49c9f-95eb-4029-9f9f-e5b077d3b42f tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:39.172024 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-e5e49c9f-95eb-4029-9f9f-e5b077d3b42f tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:39.173066 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-e5e49c9f-95eb-4029-9f9f-e5b077d3b42f tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:39.173646 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-e5e49c9f-95eb-4029-9f9f-e5b077d3b42f tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:39.198415 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-e00a9d59-fdcb-41a5-8c9c-4e4f756cd17d tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14f6f890deb74eadab6b1ff4b6431036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e991e35dc5b463fbf9f08db0e72cf46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:10:39.210295 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-e00a9d59-fdcb-41a5-8c9c-4e4f756cd17d tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] 10.222.0.79 "GET /compute/v2.1/servers/086c6296-168f-46fc-9ec4-8700b7c6ca9f" status: 200 len: 1755 microversion: 2.1 time: 0.172526 Jan 28 02:10:39.211529 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 354/748] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:10:39 2022] GET /compute/v2.1/servers/086c6296-168f-46fc-9ec4-8700b7c6ca9f => generated 1755 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:10:39.263322 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.objects.instance [None req-e5e49c9f-95eb-4029-9f9f-e5b077d3b42f tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lazy-loading 'services' on Instance uuid 4f25403b-0399-48d0-86a9-6e5022287c84 {{(pid=116374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jan 28 02:10:39.563054 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-e5e49c9f-95eb-4029-9f9f-e5b077d3b42f tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "DELETE /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84/os-volume_attachments/dac4f435-89c0-430b-8eb7-66be785cbcbe" status: 202 len: 0 microversion: 2.20 time: 0.404019 Jan 28 02:10:39.563568 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 395/749] 10.222.0.79 () {60 vars in 1456 bytes} [Fri Jan 28 02:10:39 2022] DELETE /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84/os-volume_attachments/dac4f435-89c0-430b-8eb7-66be785cbcbe => generated 0 bytes in 405 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jan 28 02:10:39.573209 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-92d75513-1e21-4aae-b7d5-0bbfc91b5539 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:10:39.574177 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-92d75513-1e21-4aae-b7d5-0bbfc91b5539 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:10:39.579846 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-92d75513-1e21-4aae-b7d5-0bbfc91b5539 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:39.580317 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-92d75513-1e21-4aae-b7d5-0bbfc91b5539 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:39.581065 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-92d75513-1e21-4aae-b7d5-0bbfc91b5539 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:39.581493 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-92d75513-1e21-4aae-b7d5-0bbfc91b5539 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:39.615958 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-92d75513-1e21-4aae-b7d5-0bbfc91b5539 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046881 Jan 28 02:10:39.620374 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 355/750] 10.222.0.79 () {60 vars in 1342 bytes} [Fri Jan 28 02:10:39 2022] GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 02:10:40.056347 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-ae013b7c-8413-4135-926e-e033d9774b0f tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:10:40.057037 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-ae013b7c-8413-4135-926e-e033d9774b0f tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] [instance: f529663e-c976-44f4-b501-5c3469c86721] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:10:40.063723 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-ae013b7c-8413-4135-926e-e033d9774b0f tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:40.064196 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-ae013b7c-8413-4135-926e-e033d9774b0f tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:40.064956 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-ae013b7c-8413-4135-926e-e033d9774b0f tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:40.065875 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-ae013b7c-8413-4135-926e-e033d9774b0f tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:40.079230 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.wsgi [None req-ae013b7c-8413-4135-926e-e033d9774b0f tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] HTTP exception thrown: Instance f529663e-c976-44f4-b501-5c3469c86721 could not be found. Jan 28 02:10:40.079812 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-ae013b7c-8413-4135-926e-e033d9774b0f tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Returning 404 to user: Instance f529663e-c976-44f4-b501-5c3469c86721 could not be found. {{(pid=116374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 02:10:40.081333 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-ae013b7c-8413-4135-926e-e033d9774b0f tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] 10.222.0.79 "GET /compute/v2.1/servers/f529663e-c976-44f4-b501-5c3469c86721" status: 404 len: 111 microversion: 2.1 time: 0.028455 Jan 28 02:10:40.081880 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 396/751] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:10:40 2022] GET /compute/v2.1/servers/f529663e-c976-44f4-b501-5c3469c86721 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 02:10:40.231575 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-c36b2f94-5272-40da-b339-d41dd66e6ecc tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:10:40.232228 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-c36b2f94-5272-40da-b339-d41dd66e6ecc tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] [instance: 086c6296-168f-46fc-9ec4-8700b7c6ca9f] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:10:40.238386 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c36b2f94-5272-40da-b339-d41dd66e6ecc tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:40.238827 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c36b2f94-5272-40da-b339-d41dd66e6ecc tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:40.239618 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c36b2f94-5272-40da-b339-d41dd66e6ecc tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:40.240134 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c36b2f94-5272-40da-b339-d41dd66e6ecc tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:40.367657 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-c36b2f94-5272-40da-b339-d41dd66e6ecc tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14f6f890deb74eadab6b1ff4b6431036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e991e35dc5b463fbf9f08db0e72cf46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:10:40.375200 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-c36b2f94-5272-40da-b339-d41dd66e6ecc tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] 10.222.0.79 "GET /compute/v2.1/servers/086c6296-168f-46fc-9ec4-8700b7c6ca9f" status: 200 len: 1755 microversion: 2.1 time: 0.147280 Jan 28 02:10:40.375765 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 356/752] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:10:40 2022] GET /compute/v2.1/servers/086c6296-168f-46fc-9ec4-8700b7c6ca9f => generated 1755 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:10:40.626809 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-99f6aa33-4fd0-40da-9631-767641bcde74 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:10:40.638645 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-99f6aa33-4fd0-40da-9631-767641bcde74 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:10:40.638645 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-99f6aa33-4fd0-40da-9631-767641bcde74 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:40.638645 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-99f6aa33-4fd0-40da-9631-767641bcde74 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:40.638645 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-99f6aa33-4fd0-40da-9631-767641bcde74 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:40.639026 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-99f6aa33-4fd0-40da-9631-767641bcde74 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:40.664499 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-99f6aa33-4fd0-40da-9631-767641bcde74 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041531 Jan 28 02:10:40.665042 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 397/753] 10.222.0.79 () {60 vars in 1342 bytes} [Fri Jan 28 02:10:40 2022] GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 02:10:41.393812 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-466e2b30-024c-429a-bb84-3a77e2a24bb0 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:10:41.394528 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-466e2b30-024c-429a-bb84-3a77e2a24bb0 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] [instance: 086c6296-168f-46fc-9ec4-8700b7c6ca9f] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:10:41.402070 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-466e2b30-024c-429a-bb84-3a77e2a24bb0 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:41.407340 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-466e2b30-024c-429a-bb84-3a77e2a24bb0 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:41.407340 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-466e2b30-024c-429a-bb84-3a77e2a24bb0 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:41.407340 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-466e2b30-024c-429a-bb84-3a77e2a24bb0 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:41.437855 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-6afbb045-537c-43a6-a4ad-ac75039bf1d5 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:10:41.438404 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-6afbb045-537c-43a6-a4ad-ac75039bf1d5 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] [instance: f6852bd3-1574-4ae7-a78f-16f07931687b] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:10:41.445044 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-6afbb045-537c-43a6-a4ad-ac75039bf1d5 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:41.459119 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-6afbb045-537c-43a6-a4ad-ac75039bf1d5 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:41.459119 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-6afbb045-537c-43a6-a4ad-ac75039bf1d5 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:41.459119 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-6afbb045-537c-43a6-a4ad-ac75039bf1d5 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:41.473741 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-6afbb045-537c-43a6-a4ad-ac75039bf1d5 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] [instance: f6852bd3-1574-4ae7-a78f-16f07931687b] Going to try to terminate instance {{(pid=116374) delete /opt/stack/nova/nova/compute/api.py:2612}} Jan 28 02:10:41.530519 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-466e2b30-024c-429a-bb84-3a77e2a24bb0 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14f6f890deb74eadab6b1ff4b6431036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e991e35dc5b463fbf9f08db0e72cf46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:10:41.538967 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-466e2b30-024c-429a-bb84-3a77e2a24bb0 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] 10.222.0.79 "GET /compute/v2.1/servers/086c6296-168f-46fc-9ec4-8700b7c6ca9f" status: 200 len: 1755 microversion: 2.1 time: 0.149607 Jan 28 02:10:41.539537 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 357/754] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:10:41 2022] GET /compute/v2.1/servers/086c6296-168f-46fc-9ec4-8700b7c6ca9f => generated 1755 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:10:41.675354 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-ed310f85-e19d-4a00-8a55-b9d237a020d4 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:10:41.676359 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-ed310f85-e19d-4a00-8a55-b9d237a020d4 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:10:41.682069 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ed310f85-e19d-4a00-8a55-b9d237a020d4 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:41.682506 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ed310f85-e19d-4a00-8a55-b9d237a020d4 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:41.683253 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ed310f85-e19d-4a00-8a55-b9d237a020d4 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:41.683674 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ed310f85-e19d-4a00-8a55-b9d237a020d4 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:41.713426 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-ed310f85-e19d-4a00-8a55-b9d237a020d4 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.041806 Jan 28 02:10:41.714111 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 358/755] 10.222.0.79 () {60 vars in 1342 bytes} [Fri Jan 28 02:10:41 2022] GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:10:41.775649 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-3966b8a6-e558-43eb-a844-dd432ed0d38c tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:10:41.776165 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-3966b8a6-e558-43eb-a844-dd432ed0d38c tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:10:41.782490 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-3966b8a6-e558-43eb-a844-dd432ed0d38c tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:41.782964 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-3966b8a6-e558-43eb-a844-dd432ed0d38c tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:41.783772 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-3966b8a6-e558-43eb-a844-dd432ed0d38c tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:41.784226 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-3966b8a6-e558-43eb-a844-dd432ed0d38c tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:41.810015 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-3966b8a6-e558-43eb-a844-dd432ed0d38c tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Going to try to terminate instance {{(pid=116375) delete /opt/stack/nova/nova/compute/api.py:2612}} Jan 28 02:10:41.864468 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-6afbb045-537c-43a6-a4ad-ac75039bf1d5 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] 10.222.0.79 "DELETE /compute/v2.1/servers/f6852bd3-1574-4ae7-a78f-16f07931687b" status: 204 len: 0 microversion: 2.1 time: 0.429243 Jan 28 02:10:41.868909 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 398/756] 10.222.0.79 () {58 vars in 1238 bytes} [Fri Jan 28 02:10:41 2022] DELETE /compute/v2.1/servers/f6852bd3-1574-4ae7-a78f-16f07931687b => generated 0 bytes in 432 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 28 02:10:41.873597 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-fb4f848f-8dfb-44f4-8326-9ad201f382d6 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:10:41.874301 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-fb4f848f-8dfb-44f4-8326-9ad201f382d6 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] [instance: f6852bd3-1574-4ae7-a78f-16f07931687b] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:10:41.882161 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-fb4f848f-8dfb-44f4-8326-9ad201f382d6 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:41.882499 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-fb4f848f-8dfb-44f4-8326-9ad201f382d6 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:41.883281 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-fb4f848f-8dfb-44f4-8326-9ad201f382d6 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:41.883821 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-fb4f848f-8dfb-44f4-8326-9ad201f382d6 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:42.035826 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-fb4f848f-8dfb-44f4-8326-9ad201f382d6 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b019715a14074e059730965913694e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b66ddee4c864aae90b738695dffbeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:10:42.044328 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-fb4f848f-8dfb-44f4-8326-9ad201f382d6 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] 10.222.0.79 "GET /compute/v2.1/servers/f6852bd3-1574-4ae7-a78f-16f07931687b" status: 200 len: 1514 microversion: 2.1 time: 0.174474 Jan 28 02:10:42.045146 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 399/757] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:10:41 2022] GET /compute/v2.1/servers/f6852bd3-1574-4ae7-a78f-16f07931687b => generated 1514 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:10:42.175481 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-3966b8a6-e558-43eb-a844-dd432ed0d38c tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "DELETE /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84" status: 204 len: 0 microversion: 2.20 time: 0.403284 Jan 28 02:10:42.176759 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 359/758] 10.222.0.79 () {60 vars in 1279 bytes} [Fri Jan 28 02:10:41 2022] DELETE /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jan 28 02:10:42.184823 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-ef66f4b0-de57-4c43-9814-250c23a88e9c tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:10:42.185425 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-ef66f4b0-de57-4c43-9814-250c23a88e9c tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:10:42.191351 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-ef66f4b0-de57-4c43-9814-250c23a88e9c tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:42.192612 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-ef66f4b0-de57-4c43-9814-250c23a88e9c tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:42.193377 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-ef66f4b0-de57-4c43-9814-250c23a88e9c tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:42.193808 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-ef66f4b0-de57-4c43-9814-250c23a88e9c tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:42.316984 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-ef66f4b0-de57-4c43-9814-250c23a88e9c tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:10:42.326278 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-ef66f4b0-de57-4c43-9814-250c23a88e9c tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:10:42.327825 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-ef66f4b0-de57-4c43-9814-250c23a88e9c tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:10:42.329040 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-ef66f4b0-de57-4c43-9814-250c23a88e9c tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84" status: 200 len: 1723 microversion: 2.20 time: 0.147877 Jan 28 02:10:42.329591 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 400/759] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:10:42 2022] GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84 => generated 1723 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:10:42.557221 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-7665a918-3319-4640-a789-2d2c86654a89 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:10:42.557859 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-7665a918-3319-4640-a789-2d2c86654a89 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] [instance: 086c6296-168f-46fc-9ec4-8700b7c6ca9f] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:10:42.563562 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-7665a918-3319-4640-a789-2d2c86654a89 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:42.564028 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-7665a918-3319-4640-a789-2d2c86654a89 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:42.564780 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-7665a918-3319-4640-a789-2d2c86654a89 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:42.565213 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-7665a918-3319-4640-a789-2d2c86654a89 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:42.688485 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-7665a918-3319-4640-a789-2d2c86654a89 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14f6f890deb74eadab6b1ff4b6431036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e991e35dc5b463fbf9f08db0e72cf46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:10:42.696191 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-7665a918-3319-4640-a789-2d2c86654a89 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] 10.222.0.79 "GET /compute/v2.1/servers/086c6296-168f-46fc-9ec4-8700b7c6ca9f" status: 200 len: 1755 microversion: 2.1 time: 0.143029 Jan 28 02:10:42.696754 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 360/760] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:10:42 2022] GET /compute/v2.1/servers/086c6296-168f-46fc-9ec4-8700b7c6ca9f => generated 1755 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:10:43.061834 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-b8510ca6-b31a-4ca0-8e79-f4cb72209df9 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:10:43.062439 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-b8510ca6-b31a-4ca0-8e79-f4cb72209df9 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] [instance: f6852bd3-1574-4ae7-a78f-16f07931687b] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:10:43.068671 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-b8510ca6-b31a-4ca0-8e79-f4cb72209df9 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:43.069116 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-b8510ca6-b31a-4ca0-8e79-f4cb72209df9 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:43.070037 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-b8510ca6-b31a-4ca0-8e79-f4cb72209df9 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:43.070471 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-b8510ca6-b31a-4ca0-8e79-f4cb72209df9 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:43.192989 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-b8510ca6-b31a-4ca0-8e79-f4cb72209df9 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b019715a14074e059730965913694e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b66ddee4c864aae90b738695dffbeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:10:43.201103 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-b8510ca6-b31a-4ca0-8e79-f4cb72209df9 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] 10.222.0.79 "GET /compute/v2.1/servers/f6852bd3-1574-4ae7-a78f-16f07931687b" status: 200 len: 1514 microversion: 2.1 time: 0.142799 Jan 28 02:10:43.201757 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 401/761] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:10:43 2022] GET /compute/v2.1/servers/f6852bd3-1574-4ae7-a78f-16f07931687b => generated 1514 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:10:43.348921 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-2541d986-8dc8-4369-a9ad-cc548a066153 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:10:43.349759 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-2541d986-8dc8-4369-a9ad-cc548a066153 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:10:43.355999 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2541d986-8dc8-4369-a9ad-cc548a066153 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:43.356437 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2541d986-8dc8-4369-a9ad-cc548a066153 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:43.357185 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2541d986-8dc8-4369-a9ad-cc548a066153 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:43.357646 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2541d986-8dc8-4369-a9ad-cc548a066153 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:43.477849 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-2541d986-8dc8-4369-a9ad-cc548a066153 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:10:43.485748 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-2541d986-8dc8-4369-a9ad-cc548a066153 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:10:43.487282 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-2541d986-8dc8-4369-a9ad-cc548a066153 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:10:43.488472 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-2541d986-8dc8-4369-a9ad-cc548a066153 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84" status: 200 len: 1723 microversion: 2.20 time: 0.144260 Jan 28 02:10:43.489034 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 361/762] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:10:43 2022] GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84 => generated 1723 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:10:43.713641 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-1190f400-6fed-4583-8db3-eb8718975de7 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:10:43.714243 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-1190f400-6fed-4583-8db3-eb8718975de7 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] [instance: 086c6296-168f-46fc-9ec4-8700b7c6ca9f] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:10:43.720680 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-1190f400-6fed-4583-8db3-eb8718975de7 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:43.721229 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-1190f400-6fed-4583-8db3-eb8718975de7 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:43.722148 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-1190f400-6fed-4583-8db3-eb8718975de7 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:43.722744 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-1190f400-6fed-4583-8db3-eb8718975de7 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:43.849490 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-1190f400-6fed-4583-8db3-eb8718975de7 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14f6f890deb74eadab6b1ff4b6431036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e991e35dc5b463fbf9f08db0e72cf46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:10:43.857471 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-1190f400-6fed-4583-8db3-eb8718975de7 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] 10.222.0.79 "GET /compute/v2.1/servers/086c6296-168f-46fc-9ec4-8700b7c6ca9f" status: 200 len: 1755 microversion: 2.1 time: 0.147494 Jan 28 02:10:43.858043 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 402/763] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:10:43 2022] GET /compute/v2.1/servers/086c6296-168f-46fc-9ec4-8700b7c6ca9f => generated 1755 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:10:44.218863 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-53b2f2f3-3ab2-43aa-8170-20bc2dbc15d5 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:10:44.219619 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-53b2f2f3-3ab2-43aa-8170-20bc2dbc15d5 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] [instance: f6852bd3-1574-4ae7-a78f-16f07931687b] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:10:44.225908 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-53b2f2f3-3ab2-43aa-8170-20bc2dbc15d5 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:44.227205 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-53b2f2f3-3ab2-43aa-8170-20bc2dbc15d5 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:44.227205 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-53b2f2f3-3ab2-43aa-8170-20bc2dbc15d5 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:44.227566 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-53b2f2f3-3ab2-43aa-8170-20bc2dbc15d5 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:44.414386 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-53b2f2f3-3ab2-43aa-8170-20bc2dbc15d5 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b019715a14074e059730965913694e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b66ddee4c864aae90b738695dffbeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:10:44.421482 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-53b2f2f3-3ab2-43aa-8170-20bc2dbc15d5 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] 10.222.0.79 "GET /compute/v2.1/servers/f6852bd3-1574-4ae7-a78f-16f07931687b" status: 200 len: 1514 microversion: 2.1 time: 0.206382 Jan 28 02:10:44.422043 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 362/764] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:10:44 2022] GET /compute/v2.1/servers/f6852bd3-1574-4ae7-a78f-16f07931687b => generated 1514 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:10:44.506743 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-b88af96a-caf1-4c8a-bd7f-de47c3869ed7 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:10:44.507343 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-b88af96a-caf1-4c8a-bd7f-de47c3869ed7 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:10:44.513016 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-b88af96a-caf1-4c8a-bd7f-de47c3869ed7 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:44.513463 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-b88af96a-caf1-4c8a-bd7f-de47c3869ed7 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:44.514251 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-b88af96a-caf1-4c8a-bd7f-de47c3869ed7 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:44.514674 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-b88af96a-caf1-4c8a-bd7f-de47c3869ed7 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:44.804643 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-b88af96a-caf1-4c8a-bd7f-de47c3869ed7 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:10:44.813504 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-b88af96a-caf1-4c8a-bd7f-de47c3869ed7 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:10:44.815627 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-b88af96a-caf1-4c8a-bd7f-de47c3869ed7 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:10:44.817025 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-b88af96a-caf1-4c8a-bd7f-de47c3869ed7 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84" status: 200 len: 1723 microversion: 2.20 time: 0.314260 Jan 28 02:10:44.817721 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 403/765] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:10:44 2022] GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84 => generated 1723 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:10:44.874446 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-224ae21e-7884-4e91-a4a3-2f5e731bfe82 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:10:44.881580 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-224ae21e-7884-4e91-a4a3-2f5e731bfe82 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] [instance: 086c6296-168f-46fc-9ec4-8700b7c6ca9f] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:10:44.881580 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-224ae21e-7884-4e91-a4a3-2f5e731bfe82 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:44.882031 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-224ae21e-7884-4e91-a4a3-2f5e731bfe82 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:44.882867 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-224ae21e-7884-4e91-a4a3-2f5e731bfe82 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:44.883344 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-224ae21e-7884-4e91-a4a3-2f5e731bfe82 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:45.071064 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [req-2ce99d1b-11ec-4852-a911-c5f49ca03b63 req-b3b2e542-0919-43d2-bc4d-7ccf8836c4c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6852bd3-1574-4ae7-a78f-16f07931687b", "name": "network-vif-deleted", "tag": "9f5a06ae-9758-488e-b71f-7103e118fef7"}]} {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:10:45.072654 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:10:45.072654 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: warnings.warn(msg) Jan 28 02:10:45.080368 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [req-2ce99d1b-11ec-4852-a911-c5f49ca03b63 req-b3b2e542-0919-43d2-bc4d-7ccf8836c4c5 service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:45.081008 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [req-2ce99d1b-11ec-4852-a911-c5f49ca03b63 req-b3b2e542-0919-43d2-bc4d-7ccf8836c4c5 service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:45.092839 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.compute.server_external_events [req-2ce99d1b-11ec-4852-a911-c5f49ca03b63 req-b3b2e542-0919-43d2-bc4d-7ccf8836c4c5 service nova] Creating event network-vif-deleted:9f5a06ae-9758-488e-b71f-7103e118fef7 for instance f6852bd3-1574-4ae7-a78f-16f07931687b on hv-cinder-82497 Jan 28 02:10:45.101801 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [req-2ce99d1b-11ec-4852-a911-c5f49ca03b63 req-b3b2e542-0919-43d2-bc4d-7ccf8836c4c5 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034731 Jan 28 02:10:45.102812 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 404/766] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Jan 28 02:10:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:10:45.440109 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-fff73645-3b0a-4527-976a-fdc342d477f1 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:10:45.440794 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-fff73645-3b0a-4527-976a-fdc342d477f1 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] [instance: f6852bd3-1574-4ae7-a78f-16f07931687b] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:10:45.448630 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-fff73645-3b0a-4527-976a-fdc342d477f1 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:45.449060 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-fff73645-3b0a-4527-976a-fdc342d477f1 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:45.449830 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-fff73645-3b0a-4527-976a-fdc342d477f1 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:45.450254 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-fff73645-3b0a-4527-976a-fdc342d477f1 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:45.494912 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-fff73645-3b0a-4527-976a-fdc342d477f1 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:45.495345 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-fff73645-3b0a-4527-976a-fdc342d477f1 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:45.495798 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.objects.instance [None req-fff73645-3b0a-4527-976a-fdc342d477f1 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lazy-loading 'fault' on Instance uuid f6852bd3-1574-4ae7-a78f-16f07931687b {{(pid=116374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jan 28 02:10:45.517016 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-224ae21e-7884-4e91-a4a3-2f5e731bfe82 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14f6f890deb74eadab6b1ff4b6431036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e991e35dc5b463fbf9f08db0e72cf46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:10:45.524990 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-224ae21e-7884-4e91-a4a3-2f5e731bfe82 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] 10.222.0.79 "GET /compute/v2.1/servers/086c6296-168f-46fc-9ec4-8700b7c6ca9f" status: 200 len: 1755 microversion: 2.1 time: 0.654351 Jan 28 02:10:45.525779 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 363/767] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:10:44 2022] GET /compute/v2.1/servers/086c6296-168f-46fc-9ec4-8700b7c6ca9f => generated 1755 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:10:45.549354 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-fff73645-3b0a-4527-976a-fdc342d477f1 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b019715a14074e059730965913694e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b66ddee4c864aae90b738695dffbeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:10:45.558736 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-fff73645-3b0a-4527-976a-fdc342d477f1 tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] 10.222.0.79 "GET /compute/v2.1/servers/f6852bd3-1574-4ae7-a78f-16f07931687b" status: 200 len: 1307 microversion: 2.1 time: 0.123755 Jan 28 02:10:45.559322 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 405/768] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:10:45 2022] GET /compute/v2.1/servers/f6852bd3-1574-4ae7-a78f-16f07931687b => generated 1307 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:10:45.839708 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-623fc127-2215-4386-b8c9-791d8dd1ad99 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:10:45.840407 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-623fc127-2215-4386-b8c9-791d8dd1ad99 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:10:45.846936 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-623fc127-2215-4386-b8c9-791d8dd1ad99 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:45.847393 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-623fc127-2215-4386-b8c9-791d8dd1ad99 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:45.848243 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-623fc127-2215-4386-b8c9-791d8dd1ad99 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:45.849878 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-623fc127-2215-4386-b8c9-791d8dd1ad99 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:45.940719 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-623fc127-2215-4386-b8c9-791d8dd1ad99 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:10:45.950307 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-623fc127-2215-4386-b8c9-791d8dd1ad99 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:10:45.951859 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-623fc127-2215-4386-b8c9-791d8dd1ad99 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:10:45.955162 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-623fc127-2215-4386-b8c9-791d8dd1ad99 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84" status: 200 len: 1655 microversion: 2.20 time: 0.118004 Jan 28 02:10:45.955162 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 364/769] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:10:45 2022] GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84 => generated 1655 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:10:46.541789 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-25db8f81-64b7-40fd-b523-9816bb21ac8f tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:10:46.542402 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-25db8f81-64b7-40fd-b523-9816bb21ac8f tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] [instance: 086c6296-168f-46fc-9ec4-8700b7c6ca9f] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:10:46.548278 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-25db8f81-64b7-40fd-b523-9816bb21ac8f tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:46.548725 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-25db8f81-64b7-40fd-b523-9816bb21ac8f tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:46.549519 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-25db8f81-64b7-40fd-b523-9816bb21ac8f tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:46.550099 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-25db8f81-64b7-40fd-b523-9816bb21ac8f tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:46.582522 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-52ccb104-884f-4a4b-a4c6-b572b22f062c tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:10:46.590690 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-52ccb104-884f-4a4b-a4c6-b572b22f062c tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] [instance: f6852bd3-1574-4ae7-a78f-16f07931687b] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:10:46.599612 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-52ccb104-884f-4a4b-a4c6-b572b22f062c tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:46.600368 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-52ccb104-884f-4a4b-a4c6-b572b22f062c tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:46.601303 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-52ccb104-884f-4a4b-a4c6-b572b22f062c tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:46.601884 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-52ccb104-884f-4a4b-a4c6-b572b22f062c tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:46.639354 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.wsgi [None req-52ccb104-884f-4a4b-a4c6-b572b22f062c tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] HTTP exception thrown: Instance f6852bd3-1574-4ae7-a78f-16f07931687b could not be found. Jan 28 02:10:46.640996 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-52ccb104-884f-4a4b-a4c6-b572b22f062c tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] Returning 404 to user: Instance f6852bd3-1574-4ae7-a78f-16f07931687b could not be found. {{(pid=116375) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 02:10:46.642754 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-52ccb104-884f-4a4b-a4c6-b572b22f062c tempest-AttachVolumeNegativeTest-1839332993 tempest-AttachVolumeNegativeTest-1839332993-project] 10.222.0.79 "GET /compute/v2.1/servers/f6852bd3-1574-4ae7-a78f-16f07931687b" status: 404 len: 111 microversion: 2.1 time: 0.063348 Jan 28 02:10:46.643635 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 365/770] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:10:46 2022] GET /compute/v2.1/servers/f6852bd3-1574-4ae7-a78f-16f07931687b => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 28 02:10:46.709861 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-25db8f81-64b7-40fd-b523-9816bb21ac8f tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14f6f890deb74eadab6b1ff4b6431036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e991e35dc5b463fbf9f08db0e72cf46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:10:46.718888 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-25db8f81-64b7-40fd-b523-9816bb21ac8f tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] 10.222.0.79 "GET /compute/v2.1/servers/086c6296-168f-46fc-9ec4-8700b7c6ca9f" status: 200 len: 1758 microversion: 2.1 time: 0.180886 Jan 28 02:10:46.719734 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 406/771] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:10:46 2022] GET /compute/v2.1/servers/086c6296-168f-46fc-9ec4-8700b7c6ca9f => generated 1758 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:10:46.974127 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-71a4c3b8-31ef-4328-8d20-8098f91bf806 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:10:46.978015 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-71a4c3b8-31ef-4328-8d20-8098f91bf806 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:10:46.981975 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-71a4c3b8-31ef-4328-8d20-8098f91bf806 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:46.982913 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-71a4c3b8-31ef-4328-8d20-8098f91bf806 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:46.983936 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-71a4c3b8-31ef-4328-8d20-8098f91bf806 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:46.984695 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-71a4c3b8-31ef-4328-8d20-8098f91bf806 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:47.026685 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-71a4c3b8-31ef-4328-8d20-8098f91bf806 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:47.027568 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-71a4c3b8-31ef-4328-8d20-8098f91bf806 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:47.028268 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.objects.instance [None req-71a4c3b8-31ef-4328-8d20-8098f91bf806 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lazy-loading 'fault' on Instance uuid 4f25403b-0399-48d0-86a9-6e5022287c84 {{(pid=116375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jan 28 02:10:47.086936 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-71a4c3b8-31ef-4328-8d20-8098f91bf806 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:10:47.097129 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-71a4c3b8-31ef-4328-8d20-8098f91bf806 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:10:47.098685 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-71a4c3b8-31ef-4328-8d20-8098f91bf806 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:10:47.100109 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-71a4c3b8-31ef-4328-8d20-8098f91bf806 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84" status: 200 len: 1372 microversion: 2.20 time: 0.131404 Jan 28 02:10:47.110995 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 366/772] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:10:46 2022] GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84 => generated 1372 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:10:47.147103 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [req-96efb481-7caf-41e2-9abc-a37b1ed8e85b req-13f0175a-8b08-48be-beec-9e0f129ed239 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f25403b-0399-48d0-86a9-6e5022287c84", "name": "network-vif-deleted", "tag": "eb8f729a-b66f-4c5c-a62e-472c346922bb"}]} {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:10:47.148896 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:10:47.148896 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: warnings.warn(msg) Jan 28 02:10:47.157419 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [req-96efb481-7caf-41e2-9abc-a37b1ed8e85b req-13f0175a-8b08-48be-beec-9e0f129ed239 service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:47.163163 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [req-96efb481-7caf-41e2-9abc-a37b1ed8e85b req-13f0175a-8b08-48be-beec-9e0f129ed239 service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:47.191503 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.compute.server_external_events [req-96efb481-7caf-41e2-9abc-a37b1ed8e85b req-13f0175a-8b08-48be-beec-9e0f129ed239 service nova] Creating event network-vif-deleted:eb8f729a-b66f-4c5c-a62e-472c346922bb for instance 4f25403b-0399-48d0-86a9-6e5022287c84 on hv-cinder-82497 Jan 28 02:10:47.198722 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [req-96efb481-7caf-41e2-9abc-a37b1ed8e85b req-13f0175a-8b08-48be-beec-9e0f129ed239 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055337 Jan 28 02:10:47.199108 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 407/773] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Jan 28 02:10:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 02:10:48.119095 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-e50ceb8f-4cc2-490b-a4b8-60b1435ffd22 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:10:48.119728 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-e50ceb8f-4cc2-490b-a4b8-60b1435ffd22 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:10:48.125782 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-e50ceb8f-4cc2-490b-a4b8-60b1435ffd22 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:48.126232 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-e50ceb8f-4cc2-490b-a4b8-60b1435ffd22 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:48.127012 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-e50ceb8f-4cc2-490b-a4b8-60b1435ffd22 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:48.127466 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-e50ceb8f-4cc2-490b-a4b8-60b1435ffd22 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:48.142516 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.wsgi [None req-e50ceb8f-4cc2-490b-a4b8-60b1435ffd22 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] HTTP exception thrown: Instance 4f25403b-0399-48d0-86a9-6e5022287c84 could not be found. Jan 28 02:10:48.143109 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-e50ceb8f-4cc2-490b-a4b8-60b1435ffd22 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Returning 404 to user: Instance 4f25403b-0399-48d0-86a9-6e5022287c84 could not be found. {{(pid=116375) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 02:10:48.143933 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-e50ceb8f-4cc2-490b-a4b8-60b1435ffd22 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84" status: 404 len: 111 microversion: 2.20 time: 0.028651 Jan 28 02:10:48.144862 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 367/774] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:10:48 2022] GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 28 02:10:48.153572 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-3949d3ae-5955-479e-a70f-171cd6cd84a7 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '.version_select at 0x7f837c467790>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:10:48.270028 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-3949d3ae-5955-479e-a70f-171cd6cd84a7 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1952223728" status: 204 len: 0 microversion: 2.20 time: 0.120349 Jan 28 02:10:48.270779 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 408/775] 10.222.0.79 () {60 vars in 1261 bytes} [Fri Jan 28 02:10:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1952223728 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 28 02:10:49.154430 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-e12f5a11-1de9-493a-9635-dcc6daa97225 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Action: 'create', calling method: .version_select at 0x7f836fd52ee0>, body: {"keypair": {"name": "tempest-keypair-308870601"}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:10:49.171739 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.quota [None req-e12f5a11-1de9-493a-9635-dcc6daa97225 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Getting quotas for project 6bdd27e926a84fa49844fbcca271bb19. Resources: {'key_pairs'} {{(pid=116375) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 02:10:49.175478 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.quota [None req-e12f5a11-1de9-493a-9635-dcc6daa97225 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Getting quotas for user a6e7ef3a7fd145e5ab8726786ba318bb and project 6bdd27e926a84fa49844fbcca271bb19. Resources: {'key_pairs'} {{(pid=116375) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 02:10:49.503855 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-73af2382-3410-48d3-a5ff-afb353ce27cb tempest-VolumesGetTestJSON-390030211 tempest-VolumesGetTestJSON-390030211-project] Action: 'create', calling method: .version_select at 0x7f837d243670>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1534751585", "metadata": {"Type": "work"}}} {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:10:49.655505 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.quota [None req-e12f5a11-1de9-493a-9635-dcc6daa97225 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Getting quotas for project 6bdd27e926a84fa49844fbcca271bb19. Resources: {'key_pairs'} {{(pid=116375) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 02:10:49.659235 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.quota [None req-e12f5a11-1de9-493a-9635-dcc6daa97225 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Getting quotas for user a6e7ef3a7fd145e5ab8726786ba318bb and project 6bdd27e926a84fa49844fbcca271bb19. Resources: {'key_pairs'} {{(pid=116375) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 02:10:49.672668 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-e12f5a11-1de9-493a-9635-dcc6daa97225 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 201 len: 2315 microversion: 2.20 time: 0.522159 Jan 28 02:10:49.673262 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 368/776] 10.222.0.79 () {62 vars in 1198 bytes} [Fri Jan 28 02:10:49 2022] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 523 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Jan 28 02:10:50.067375 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-73af2382-3410-48d3-a5ff-afb353ce27cb tempest-VolumesGetTestJSON-390030211 tempest-VolumesGetTestJSON-390030211-project] 10.222.0.79 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.681674 Jan 28 02:10:50.068011 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 409/777] 10.222.0.79 () {60 vars in 1155 bytes} [Fri Jan 28 02:10:49 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 683 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Jan 28 02:10:50.078599 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-97867625-074e-42ba-a102-08515c544755 tempest-VolumesGetTestJSON-390030211 tempest-VolumesGetTestJSON-390030211-project] Calling method '.version_select at 0x7f836fe61ee0>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:10:50.148810 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-97867625-074e-42ba-a102-08515c544755 tempest-VolumesGetTestJSON-390030211 tempest-VolumesGetTestJSON-390030211-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/f4b57928-6695-4239-a82d-4adc4420d488" status: 200 len: 353 microversion: 2.1 time: 0.073662 Jan 28 02:10:50.149335 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 369/778] 10.222.0.79 () {58 vars in 1244 bytes} [Fri Jan 28 02:10:50 2022] GET /compute/v2.1/os-volumes/f4b57928-6695-4239-a82d-4adc4420d488 => generated 353 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:10:51.164216 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-de9bced8-683d-4887-9531-350a8772efd0 tempest-VolumesGetTestJSON-390030211 tempest-VolumesGetTestJSON-390030211-project] Calling method '.version_select at 0x7f837c4a1ee0>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:10:51.220531 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-de9bced8-683d-4887-9531-350a8772efd0 tempest-VolumesGetTestJSON-390030211 tempest-VolumesGetTestJSON-390030211-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/f4b57928-6695-4239-a82d-4adc4420d488" status: 200 len: 354 microversion: 2.1 time: 0.060340 Jan 28 02:10:51.221320 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 410/779] 10.222.0.79 () {58 vars in 1244 bytes} [Fri Jan 28 02:10:51 2022] GET /compute/v2.1/os-volumes/f4b57928-6695-4239-a82d-4adc4420d488 => generated 354 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:10:51.233252 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-f7281ab6-1bca-4b30-9927-b45f7ec9e78d tempest-VolumesGetTestJSON-390030211 tempest-VolumesGetTestJSON-390030211-project] Calling method '.version_select at 0x7f836fe271f0>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:10:51.289180 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-f7281ab6-1bca-4b30-9927-b45f7ec9e78d tempest-VolumesGetTestJSON-390030211 tempest-VolumesGetTestJSON-390030211-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/f4b57928-6695-4239-a82d-4adc4420d488" status: 200 len: 354 microversion: 2.1 time: 0.059839 Jan 28 02:10:51.289741 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 370/780] 10.222.0.79 () {58 vars in 1244 bytes} [Fri Jan 28 02:10:51 2022] GET /compute/v2.1/os-volumes/f4b57928-6695-4239-a82d-4adc4420d488 => generated 354 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 02:10:51.509031 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-08db74aa-a955-41ab-9fcf-2d50c627b570 tempest-VolumesGetTestJSON-390030211 tempest-VolumesGetTestJSON-390030211-project] Calling method '.version_select at 0x7f837c4b6700>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:10:51.805582 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-08db74aa-a955-41ab-9fcf-2d50c627b570 tempest-VolumesGetTestJSON-390030211 tempest-VolumesGetTestJSON-390030211-project] 10.222.0.79 "DELETE /compute/v2.1/os-volumes/f4b57928-6695-4239-a82d-4adc4420d488" status: 202 len: 0 microversion: 2.1 time: 0.300489 Jan 28 02:10:51.809675 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 411/781] 10.222.0.79 () {58 vars in 1247 bytes} [Fri Jan 28 02:10:51 2022] DELETE /compute/v2.1/os-volumes/f4b57928-6695-4239-a82d-4adc4420d488 => generated 0 bytes in 302 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:10:51.814123 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-225eb412-f60f-4d43-a5de-a9ce62937017 tempest-VolumesGetTestJSON-390030211 tempest-VolumesGetTestJSON-390030211-project] Calling method '.version_select at 0x7f836fd7ff70>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:10:51.873026 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-225eb412-f60f-4d43-a5de-a9ce62937017 tempest-VolumesGetTestJSON-390030211 tempest-VolumesGetTestJSON-390030211-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/f4b57928-6695-4239-a82d-4adc4420d488" status: 200 len: 353 microversion: 2.1 time: 0.062670 Jan 28 02:10:51.873708 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 371/782] 10.222.0.79 () {58 vars in 1244 bytes} [Fri Jan 28 02:10:51 2022] GET /compute/v2.1/os-volumes/f4b57928-6695-4239-a82d-4adc4420d488 => generated 353 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 02:10:52.441194 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-d1b7b9e8-a855-4932-96a3-1e3aa85b9c89 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1021313712", "imageRef": "04805ce8-b0a0-41b2-b614-bfb5b752cc5d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "93f7fa36-86c7-4eac-8e6a-71166645bc4a"}], "security_groups": [{"name": "tempest-securitygroup--753850607"}], "key_name": "tempest-keypair-308870601", "user_data": "}} {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:10:52.541701 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.network.neutron [None req-d1b7b9e8-a855-4932-96a3-1e3aa85b9c89 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] validate_networks() for [('93f7fa36-86c7-4eac-8e6a-71166645bc4a', None, None, None, None, None)] {{(pid=116374) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Jan 28 02:10:52.886928 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-36c6e015-8c0f-43a0-9177-7ca0919e17c0 tempest-VolumesGetTestJSON-390030211 tempest-VolumesGetTestJSON-390030211-project] Calling method '.version_select at 0x7f836fd7f8b0>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:10:52.917488 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.wsgi [None req-36c6e015-8c0f-43a0-9177-7ca0919e17c0 tempest-VolumesGetTestJSON-390030211 tempest-VolumesGetTestJSON-390030211-project] HTTP exception thrown: Volume f4b57928-6695-4239-a82d-4adc4420d488 could not be found. Jan 28 02:10:52.918238 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-36c6e015-8c0f-43a0-9177-7ca0919e17c0 tempest-VolumesGetTestJSON-390030211 tempest-VolumesGetTestJSON-390030211-project] Returning 404 to user: Volume f4b57928-6695-4239-a82d-4adc4420d488 could not be found. {{(pid=116375) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 02:10:52.922869 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-36c6e015-8c0f-43a0-9177-7ca0919e17c0 tempest-VolumesGetTestJSON-390030211 tempest-VolumesGetTestJSON-390030211-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/f4b57928-6695-4239-a82d-4adc4420d488" status: 404 len: 109 microversion: 2.1 time: 0.040370 Jan 28 02:10:52.929986 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 372/783] 10.222.0.79 () {58 vars in 1244 bytes} [Fri Jan 28 02:10:52 2022] GET /compute/v2.1/os-volumes/f4b57928-6695-4239-a82d-4adc4420d488 => generated 109 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 02:10:52.945719 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.virt.hardware [None req-d1b7b9e8-a855-4932-96a3-1e3aa85b9c89 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Flavor limits 0:0:0 {{(pid=116374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 02:10:52.946139 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.virt.hardware [None req-d1b7b9e8-a855-4932-96a3-1e3aa85b9c89 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Image limits 0:0:0 {{(pid=116374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 02:10:52.946602 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.virt.hardware [None req-d1b7b9e8-a855-4932-96a3-1e3aa85b9c89 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Flavor pref 0:0:0 {{(pid=116374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 02:10:52.947005 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.virt.hardware [None req-d1b7b9e8-a855-4932-96a3-1e3aa85b9c89 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Image pref 0:0:0 {{(pid=116374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 02:10:52.949516 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.virt.hardware [None req-d1b7b9e8-a855-4932-96a3-1e3aa85b9c89 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 02:10:52.956114 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-d1b7b9e8-a855-4932-96a3-1e3aa85b9c89 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:52.956557 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-d1b7b9e8-a855-4932-96a3-1e3aa85b9c89 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:52.957347 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-d1b7b9e8-a855-4932-96a3-1e3aa85b9c89 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:52.957773 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-d1b7b9e8-a855-4932-96a3-1e3aa85b9c89 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:52.975883 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.quota [None req-d1b7b9e8-a855-4932-96a3-1e3aa85b9c89 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Getting quotas for project 6bdd27e926a84fa49844fbcca271bb19. Resources: {'ram', 'cores', 'instances'} {{(pid=116374) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 02:10:52.979851 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.quota [None req-d1b7b9e8-a855-4932-96a3-1e3aa85b9c89 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Getting quotas for user a6e7ef3a7fd145e5ab8726786ba318bb and project 6bdd27e926a84fa49844fbcca271bb19. Resources: {'ram', 'cores', 'instances'} {{(pid=116374) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 02:10:52.991557 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-d1b7b9e8-a855-4932-96a3-1e3aa85b9c89 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Going to run 1 instances... {{(pid=116374) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 02:10:52.993988 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-d1b7b9e8-a855-4932-96a3-1e3aa85b9c89 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: c3ea23ca-a790-4f52-ad85-dcac640a8695] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='04805ce8-b0a0-41b2-b614-bfb5b752cc5d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116374) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 02:10:53.104743 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-d1b7b9e8-a855-4932-96a3-1e3aa85b9c89 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.667951 Jan 28 02:10:53.107699 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 412/784] 10.222.0.79 () {62 vars in 1187 bytes} [Fri Jan 28 02:10:52 2022] POST /compute/v2.1/servers => generated 401 bytes in 670 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jan 28 02:10:53.116308 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-99ea5ca0-dd9a-4e1d-bf1a-8abce7da4b6d tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:10:53.117179 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-99ea5ca0-dd9a-4e1d-bf1a-8abce7da4b6d tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: c3ea23ca-a790-4f52-ad85-dcac640a8695] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:10:53.184681 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-99ea5ca0-dd9a-4e1d-bf1a-8abce7da4b6d tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:10:53.192470 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-99ea5ca0-dd9a-4e1d-bf1a-8abce7da4b6d tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:10:53.194480 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-99ea5ca0-dd9a-4e1d-bf1a-8abce7da4b6d tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:10:53.200920 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-99ea5ca0-dd9a-4e1d-bf1a-8abce7da4b6d tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695" status: 200 len: 1281 microversion: 2.20 time: 0.083991 Jan 28 02:10:53.200920 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 373/785] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:10:53 2022] GET /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695 => generated 1281 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:10:54.214127 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-48e91955-1419-480e-aeb8-de92d8fd434c tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:10:54.214728 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-48e91955-1419-480e-aeb8-de92d8fd434c tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: c3ea23ca-a790-4f52-ad85-dcac640a8695] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:10:54.221341 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-48e91955-1419-480e-aeb8-de92d8fd434c tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:54.221784 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-48e91955-1419-480e-aeb8-de92d8fd434c tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:54.222593 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-48e91955-1419-480e-aeb8-de92d8fd434c tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:54.223015 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-48e91955-1419-480e-aeb8-de92d8fd434c tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:54.282094 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-48e91955-1419-480e-aeb8-de92d8fd434c tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:10:54.290900 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-48e91955-1419-480e-aeb8-de92d8fd434c tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:10:54.292422 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-48e91955-1419-480e-aeb8-de92d8fd434c tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:10:54.293509 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-48e91955-1419-480e-aeb8-de92d8fd434c tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695" status: 200 len: 1285 microversion: 2.20 time: 0.083238 Jan 28 02:10:54.294053 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 413/786] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:10:54 2022] GET /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695 => generated 1285 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:10:55.312250 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-f7bb8854-dc02-4bd3-bc1c-3e2edce41683 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:10:55.312943 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-f7bb8854-dc02-4bd3-bc1c-3e2edce41683 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: c3ea23ca-a790-4f52-ad85-dcac640a8695] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:10:55.320056 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f7bb8854-dc02-4bd3-bc1c-3e2edce41683 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:55.320608 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f7bb8854-dc02-4bd3-bc1c-3e2edce41683 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:55.321404 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f7bb8854-dc02-4bd3-bc1c-3e2edce41683 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:55.321856 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f7bb8854-dc02-4bd3-bc1c-3e2edce41683 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:55.379834 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-f7bb8854-dc02-4bd3-bc1c-3e2edce41683 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:10:55.388123 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-f7bb8854-dc02-4bd3-bc1c-3e2edce41683 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:10:55.389591 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-f7bb8854-dc02-4bd3-bc1c-3e2edce41683 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:10:55.390807 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-f7bb8854-dc02-4bd3-bc1c-3e2edce41683 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695" status: 200 len: 1285 microversion: 2.20 time: 0.082358 Jan 28 02:10:55.391286 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 374/787] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:10:55 2022] GET /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695 => generated 1285 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:10:56.408829 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-c6145eee-2a6d-40b2-b06b-70fbd4a16de9 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:10:56.409464 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-c6145eee-2a6d-40b2-b06b-70fbd4a16de9 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: c3ea23ca-a790-4f52-ad85-dcac640a8695] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:10:56.415846 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-c6145eee-2a6d-40b2-b06b-70fbd4a16de9 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:56.416323 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-c6145eee-2a6d-40b2-b06b-70fbd4a16de9 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:56.417082 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-c6145eee-2a6d-40b2-b06b-70fbd4a16de9 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:56.417511 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-c6145eee-2a6d-40b2-b06b-70fbd4a16de9 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:56.482097 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-c6145eee-2a6d-40b2-b06b-70fbd4a16de9 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:10:56.491922 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-c6145eee-2a6d-40b2-b06b-70fbd4a16de9 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:10:56.493702 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-c6145eee-2a6d-40b2-b06b-70fbd4a16de9 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:10:56.495001 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-c6145eee-2a6d-40b2-b06b-70fbd4a16de9 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695" status: 200 len: 1285 microversion: 2.20 time: 0.090090 Jan 28 02:10:56.495642 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 414/788] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:10:56 2022] GET /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695 => generated 1285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:10:57.513425 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-c9f455c0-9cc2-48ec-b87a-de94832581fb tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:10:57.514022 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-c9f455c0-9cc2-48ec-b87a-de94832581fb tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: c3ea23ca-a790-4f52-ad85-dcac640a8695] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:10:57.520145 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c9f455c0-9cc2-48ec-b87a-de94832581fb tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:57.521172 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c9f455c0-9cc2-48ec-b87a-de94832581fb tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:57.521953 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c9f455c0-9cc2-48ec-b87a-de94832581fb tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:57.522391 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c9f455c0-9cc2-48ec-b87a-de94832581fb tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:57.582053 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-c9f455c0-9cc2-48ec-b87a-de94832581fb tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:10:57.590749 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-c9f455c0-9cc2-48ec-b87a-de94832581fb tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:10:57.595437 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-c9f455c0-9cc2-48ec-b87a-de94832581fb tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:10:57.595437 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-c9f455c0-9cc2-48ec-b87a-de94832581fb tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695" status: 200 len: 1333 microversion: 2.20 time: 0.083742 Jan 28 02:10:57.595437 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 375/789] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:10:57 2022] GET /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695 => generated 1333 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:10:58.612539 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-68a3cc35-be16-45c4-ad5b-f8e5672b38db tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:10:58.613368 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-68a3cc35-be16-45c4-ad5b-f8e5672b38db tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: c3ea23ca-a790-4f52-ad85-dcac640a8695] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:10:58.619606 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-68a3cc35-be16-45c4-ad5b-f8e5672b38db tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:58.620092 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-68a3cc35-be16-45c4-ad5b-f8e5672b38db tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:58.620878 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-68a3cc35-be16-45c4-ad5b-f8e5672b38db tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:58.635126 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-68a3cc35-be16-45c4-ad5b-f8e5672b38db tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:58.820826 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-68a3cc35-be16-45c4-ad5b-f8e5672b38db tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:10:58.829069 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-68a3cc35-be16-45c4-ad5b-f8e5672b38db tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:10:58.830935 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-68a3cc35-be16-45c4-ad5b-f8e5672b38db tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:10:58.832087 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-68a3cc35-be16-45c4-ad5b-f8e5672b38db tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695" status: 200 len: 1406 microversion: 2.20 time: 0.223427 Jan 28 02:10:58.832658 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 415/790] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:10:58 2022] GET /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695 => generated 1406 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:10:59.840881 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [req-9be4a606-d740-4ffd-8b9f-94dc270346d7 req-cd1f8cc9-c79a-4e59-aed2-e9a75b1e2a8b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3ea23ca-a790-4f52-ad85-dcac640a8695", "tag": "a5ba13e6-3134-4ccb-b060-70df55025709"}]} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:10:59.853828 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-7197b289-04c2-4717-a25d-4f78e61841b9 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:10:59.854463 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-7197b289-04c2-4717-a25d-4f78e61841b9 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: c3ea23ca-a790-4f52-ad85-dcac640a8695] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:10:59.861595 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:10:59.861595 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: warnings.warn(msg) Jan 28 02:10:59.867412 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-7197b289-04c2-4717-a25d-4f78e61841b9 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:59.871047 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-7197b289-04c2-4717-a25d-4f78e61841b9 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:59.872254 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-7197b289-04c2-4717-a25d-4f78e61841b9 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:59.872654 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-9be4a606-d740-4ffd-8b9f-94dc270346d7 req-cd1f8cc9-c79a-4e59-aed2-e9a75b1e2a8b service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:10:59.872949 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-7197b289-04c2-4717-a25d-4f78e61841b9 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:59.873455 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-9be4a606-d740-4ffd-8b9f-94dc270346d7 req-cd1f8cc9-c79a-4e59-aed2-e9a75b1e2a8b service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:10:59.889290 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.compute.server_external_events [req-9be4a606-d740-4ffd-8b9f-94dc270346d7 req-cd1f8cc9-c79a-4e59-aed2-e9a75b1e2a8b service nova] Creating event network-changed:a5ba13e6-3134-4ccb-b060-70df55025709 for instance c3ea23ca-a790-4f52-ad85-dcac640a8695 on hv-cinder-82497 Jan 28 02:10:59.894882 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [req-9be4a606-d740-4ffd-8b9f-94dc270346d7 req-cd1f8cc9-c79a-4e59-aed2-e9a75b1e2a8b service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057623 Jan 28 02:10:59.896091 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 376/791] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Jan 28 02:10:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:11:00.119912 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-7197b289-04c2-4717-a25d-4f78e61841b9 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:11:00.131390 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-7197b289-04c2-4717-a25d-4f78e61841b9 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:11:00.140334 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-7197b289-04c2-4717-a25d-4f78e61841b9 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:11:00.140334 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-7197b289-04c2-4717-a25d-4f78e61841b9 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695" status: 200 len: 1406 microversion: 2.20 time: 0.286807 Jan 28 02:11:00.140334 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 416/792] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:10:59 2022] GET /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695 => generated 1406 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 02:11:01.154185 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-41eb74a8-8a3c-43bd-82e9-62427ac29a8f tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:11:01.154897 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-41eb74a8-8a3c-43bd-82e9-62427ac29a8f tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: c3ea23ca-a790-4f52-ad85-dcac640a8695] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:11:01.160962 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-41eb74a8-8a3c-43bd-82e9-62427ac29a8f tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:01.161412 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-41eb74a8-8a3c-43bd-82e9-62427ac29a8f tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:01.162170 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-41eb74a8-8a3c-43bd-82e9-62427ac29a8f tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:01.162598 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-41eb74a8-8a3c-43bd-82e9-62427ac29a8f tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:01.450188 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-41eb74a8-8a3c-43bd-82e9-62427ac29a8f tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:11:01.458498 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-41eb74a8-8a3c-43bd-82e9-62427ac29a8f tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:11:01.460695 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-41eb74a8-8a3c-43bd-82e9-62427ac29a8f tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:11:01.461942 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-41eb74a8-8a3c-43bd-82e9-62427ac29a8f tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695" status: 200 len: 1406 microversion: 2.20 time: 0.311837 Jan 28 02:11:01.462632 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 377/793] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:11:01 2022] GET /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695 => generated 1406 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:11:02.480823 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-ce378a2e-f168-48f0-a62f-2ae93c2ee7cc tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:11:02.481394 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-ce378a2e-f168-48f0-a62f-2ae93c2ee7cc tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: c3ea23ca-a790-4f52-ad85-dcac640a8695] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:11:02.487179 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-ce378a2e-f168-48f0-a62f-2ae93c2ee7cc tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:02.487611 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-ce378a2e-f168-48f0-a62f-2ae93c2ee7cc tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:02.488486 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-ce378a2e-f168-48f0-a62f-2ae93c2ee7cc tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:02.488909 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-ce378a2e-f168-48f0-a62f-2ae93c2ee7cc tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:02.662430 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-ce378a2e-f168-48f0-a62f-2ae93c2ee7cc tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:11:02.670297 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-ce378a2e-f168-48f0-a62f-2ae93c2ee7cc tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:11:02.671823 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-ce378a2e-f168-48f0-a62f-2ae93c2ee7cc tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:11:02.672953 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-ce378a2e-f168-48f0-a62f-2ae93c2ee7cc tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695" status: 200 len: 1406 microversion: 2.20 time: 0.195997 Jan 28 02:11:02.673514 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 417/794] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:11:02 2022] GET /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695 => generated 1406 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:11:03.691849 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-5831debb-1ef8-4ed4-9199-40dc4878d52d tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:11:03.692542 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-5831debb-1ef8-4ed4-9199-40dc4878d52d tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: c3ea23ca-a790-4f52-ad85-dcac640a8695] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:11:03.699076 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-5831debb-1ef8-4ed4-9199-40dc4878d52d tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:03.699586 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-5831debb-1ef8-4ed4-9199-40dc4878d52d tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:03.700478 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-5831debb-1ef8-4ed4-9199-40dc4878d52d tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:03.700943 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-5831debb-1ef8-4ed4-9199-40dc4878d52d tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:03.831685 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-5831debb-1ef8-4ed4-9199-40dc4878d52d tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:11:03.840135 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-5831debb-1ef8-4ed4-9199-40dc4878d52d tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:11:03.841598 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-5831debb-1ef8-4ed4-9199-40dc4878d52d tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:11:03.842682 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-5831debb-1ef8-4ed4-9199-40dc4878d52d tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695" status: 200 len: 1406 microversion: 2.20 time: 0.155359 Jan 28 02:11:03.843236 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 378/795] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:11:03 2022] GET /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695 => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:11:04.862724 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-19f9aa0b-5a56-4f90-9118-259ed11d2119 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:11:04.863336 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-19f9aa0b-5a56-4f90-9118-259ed11d2119 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: c3ea23ca-a790-4f52-ad85-dcac640a8695] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:11:04.870569 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-19f9aa0b-5a56-4f90-9118-259ed11d2119 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:04.871054 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-19f9aa0b-5a56-4f90-9118-259ed11d2119 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:04.871904 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-19f9aa0b-5a56-4f90-9118-259ed11d2119 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:04.872443 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-19f9aa0b-5a56-4f90-9118-259ed11d2119 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:04.998902 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-19f9aa0b-5a56-4f90-9118-259ed11d2119 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:11:05.006631 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-19f9aa0b-5a56-4f90-9118-259ed11d2119 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:11:05.008139 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-19f9aa0b-5a56-4f90-9118-259ed11d2119 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:11:05.009322 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-19f9aa0b-5a56-4f90-9118-259ed11d2119 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695" status: 200 len: 1406 microversion: 2.20 time: 0.150902 Jan 28 02:11:05.009883 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 418/796] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:11:04 2022] GET /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695 => generated 1406 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:11:06.026967 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-cdd48e93-5d0c-4de4-8ad4-8bf8f2921a99 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:11:06.027623 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-cdd48e93-5d0c-4de4-8ad4-8bf8f2921a99 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: c3ea23ca-a790-4f52-ad85-dcac640a8695] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:11:06.033379 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-cdd48e93-5d0c-4de4-8ad4-8bf8f2921a99 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:06.033821 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-cdd48e93-5d0c-4de4-8ad4-8bf8f2921a99 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:06.034576 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-cdd48e93-5d0c-4de4-8ad4-8bf8f2921a99 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:06.035000 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-cdd48e93-5d0c-4de4-8ad4-8bf8f2921a99 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:06.157820 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-cdd48e93-5d0c-4de4-8ad4-8bf8f2921a99 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:11:06.166515 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-cdd48e93-5d0c-4de4-8ad4-8bf8f2921a99 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:11:06.168215 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-cdd48e93-5d0c-4de4-8ad4-8bf8f2921a99 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:11:06.169389 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-cdd48e93-5d0c-4de4-8ad4-8bf8f2921a99 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695" status: 200 len: 1406 microversion: 2.20 time: 0.146231 Jan 28 02:11:06.169956 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 379/797] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:11:06 2022] GET /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695 => generated 1406 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:11:07.193155 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-513f38db-62d8-4758-803e-9b0e326b747a tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:11:07.193729 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-513f38db-62d8-4758-803e-9b0e326b747a tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: c3ea23ca-a790-4f52-ad85-dcac640a8695] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:11:07.200275 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-513f38db-62d8-4758-803e-9b0e326b747a tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:07.200718 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-513f38db-62d8-4758-803e-9b0e326b747a tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:07.201537 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-513f38db-62d8-4758-803e-9b0e326b747a tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:07.201969 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-513f38db-62d8-4758-803e-9b0e326b747a tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:07.330552 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-513f38db-62d8-4758-803e-9b0e326b747a tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:11:07.339252 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-513f38db-62d8-4758-803e-9b0e326b747a tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:11:07.340920 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-513f38db-62d8-4758-803e-9b0e326b747a tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:11:07.342094 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-513f38db-62d8-4758-803e-9b0e326b747a tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695" status: 200 len: 1406 microversion: 2.20 time: 0.152778 Jan 28 02:11:07.342724 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 419/798] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:11:07 2022] GET /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695 => generated 1406 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 02:11:08.360823 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-81a69e62-de93-437f-a9f3-169c73ad8f7d tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:11:08.361507 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-81a69e62-de93-437f-a9f3-169c73ad8f7d tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: c3ea23ca-a790-4f52-ad85-dcac640a8695] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:11:08.367147 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-81a69e62-de93-437f-a9f3-169c73ad8f7d tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:08.367659 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-81a69e62-de93-437f-a9f3-169c73ad8f7d tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:08.369210 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-81a69e62-de93-437f-a9f3-169c73ad8f7d tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:08.373360 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-81a69e62-de93-437f-a9f3-169c73ad8f7d tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:08.505110 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-81a69e62-de93-437f-a9f3-169c73ad8f7d tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:11:08.513935 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-81a69e62-de93-437f-a9f3-169c73ad8f7d tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:11:08.518319 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-81a69e62-de93-437f-a9f3-169c73ad8f7d tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:11:08.518319 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-81a69e62-de93-437f-a9f3-169c73ad8f7d tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695" status: 200 len: 1406 microversion: 2.20 time: 0.159552 Jan 28 02:11:08.518319 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 380/799] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:11:08 2022] GET /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695 => generated 1406 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:11:09.535333 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-94c3e172-9053-47b5-9627-420630ee9d65 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:11:09.535923 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-94c3e172-9053-47b5-9627-420630ee9d65 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: c3ea23ca-a790-4f52-ad85-dcac640a8695] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:11:09.542363 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-94c3e172-9053-47b5-9627-420630ee9d65 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:09.544304 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-94c3e172-9053-47b5-9627-420630ee9d65 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:09.544304 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-94c3e172-9053-47b5-9627-420630ee9d65 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:09.544304 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-94c3e172-9053-47b5-9627-420630ee9d65 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:09.663257 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-94c3e172-9053-47b5-9627-420630ee9d65 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:11:09.671614 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-94c3e172-9053-47b5-9627-420630ee9d65 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:11:09.673134 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-94c3e172-9053-47b5-9627-420630ee9d65 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:11:09.674224 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-94c3e172-9053-47b5-9627-420630ee9d65 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695" status: 200 len: 1406 microversion: 2.20 time: 0.142918 Jan 28 02:11:09.674779 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 420/800] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:11:09 2022] GET /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695 => generated 1406 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:11:10.692191 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-32e44d64-9d0c-470f-8610-3c3dcdab180d tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:11:10.692844 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-32e44d64-9d0c-470f-8610-3c3dcdab180d tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: c3ea23ca-a790-4f52-ad85-dcac640a8695] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:11:10.698638 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-32e44d64-9d0c-470f-8610-3c3dcdab180d tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:10.699077 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-32e44d64-9d0c-470f-8610-3c3dcdab180d tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:10.699857 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-32e44d64-9d0c-470f-8610-3c3dcdab180d tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:10.700473 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-32e44d64-9d0c-470f-8610-3c3dcdab180d tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:10.837400 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-32e44d64-9d0c-470f-8610-3c3dcdab180d tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:11:10.845419 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-32e44d64-9d0c-470f-8610-3c3dcdab180d tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:11:10.847172 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-32e44d64-9d0c-470f-8610-3c3dcdab180d tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:11:10.848348 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-32e44d64-9d0c-470f-8610-3c3dcdab180d tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695" status: 200 len: 1406 microversion: 2.20 time: 0.160076 Jan 28 02:11:10.848910 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 381/801] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:11:10 2022] GET /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695 => generated 1406 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:11:11.138621 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [req-76bce8e9-edf9-4f88-87e8-7f304cb834af req-af6896f1-7769-47ce-8dff-807b337a51ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3ea23ca-a790-4f52-ad85-dcac640a8695", "name": "network-vif-plugged", "status": "completed", "tag": "a5ba13e6-3134-4ccb-b060-70df55025709"}]} {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:11:11.141507 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:11:11.141507 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: warnings.warn(msg) Jan 28 02:11:11.149929 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [req-76bce8e9-edf9-4f88-87e8-7f304cb834af req-af6896f1-7769-47ce-8dff-807b337a51ec service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:11.150347 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [req-76bce8e9-edf9-4f88-87e8-7f304cb834af req-af6896f1-7769-47ce-8dff-807b337a51ec service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:11.161599 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.compute.server_external_events [req-76bce8e9-edf9-4f88-87e8-7f304cb834af req-af6896f1-7769-47ce-8dff-807b337a51ec service nova] Creating event network-vif-plugged:a5ba13e6-3134-4ccb-b060-70df55025709 for instance c3ea23ca-a790-4f52-ad85-dcac640a8695 on hv-cinder-82497 Jan 28 02:11:11.167355 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [req-76bce8e9-edf9-4f88-87e8-7f304cb834af req-af6896f1-7769-47ce-8dff-807b337a51ec service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032453 Jan 28 02:11:11.167951 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 421/802] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Jan 28 02:11:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 02:11:11.866579 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-e656f978-e4bc-4806-8a3a-58c940af4de9 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:11:11.867180 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-e656f978-e4bc-4806-8a3a-58c940af4de9 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: c3ea23ca-a790-4f52-ad85-dcac640a8695] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:11:11.873850 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-e656f978-e4bc-4806-8a3a-58c940af4de9 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:11.874295 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-e656f978-e4bc-4806-8a3a-58c940af4de9 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:11.875066 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-e656f978-e4bc-4806-8a3a-58c940af4de9 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:11.875499 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-e656f978-e4bc-4806-8a3a-58c940af4de9 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:12.012441 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-e656f978-e4bc-4806-8a3a-58c940af4de9 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:11:12.021432 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-e656f978-e4bc-4806-8a3a-58c940af4de9 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:11:12.022912 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-e656f978-e4bc-4806-8a3a-58c940af4de9 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:11:12.024285 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-e656f978-e4bc-4806-8a3a-58c940af4de9 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695" status: 200 len: 1406 microversion: 2.20 time: 0.161358 Jan 28 02:11:12.025317 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 382/803] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:11:11 2022] GET /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695 => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:11:13.045508 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-980f632d-4087-45a5-860f-5b07ab48eb71 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:11:13.046198 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-980f632d-4087-45a5-860f-5b07ab48eb71 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: c3ea23ca-a790-4f52-ad85-dcac640a8695] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:11:13.052360 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-980f632d-4087-45a5-860f-5b07ab48eb71 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:13.056475 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-980f632d-4087-45a5-860f-5b07ab48eb71 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:13.056475 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-980f632d-4087-45a5-860f-5b07ab48eb71 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:13.056475 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-980f632d-4087-45a5-860f-5b07ab48eb71 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:13.184648 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-980f632d-4087-45a5-860f-5b07ab48eb71 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:11:13.192554 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-980f632d-4087-45a5-860f-5b07ab48eb71 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:11:13.194066 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-980f632d-4087-45a5-860f-5b07ab48eb71 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:11:13.195179 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-980f632d-4087-45a5-860f-5b07ab48eb71 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695" status: 200 len: 1406 microversion: 2.20 time: 0.153887 Jan 28 02:11:13.195747 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 422/804] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:11:13 2022] GET /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695 => generated 1406 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:11:14.440705 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-55fffd99-b0f3-4d96-ba91-bdcda7bf61bc tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:11:14.441302 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-55fffd99-b0f3-4d96-ba91-bdcda7bf61bc tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: c3ea23ca-a790-4f52-ad85-dcac640a8695] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:11:14.448117 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-55fffd99-b0f3-4d96-ba91-bdcda7bf61bc tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:14.448560 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-55fffd99-b0f3-4d96-ba91-bdcda7bf61bc tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:14.449483 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-55fffd99-b0f3-4d96-ba91-bdcda7bf61bc tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:14.449817 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-55fffd99-b0f3-4d96-ba91-bdcda7bf61bc tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:14.577717 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-55fffd99-b0f3-4d96-ba91-bdcda7bf61bc tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:11:14.585702 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-55fffd99-b0f3-4d96-ba91-bdcda7bf61bc tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:11:14.588059 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-55fffd99-b0f3-4d96-ba91-bdcda7bf61bc tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:11:14.589781 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-55fffd99-b0f3-4d96-ba91-bdcda7bf61bc tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695" status: 200 len: 1596 microversion: 2.20 time: 0.379646 Jan 28 02:11:14.590042 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 383/805] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:11:14 2022] GET /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695 => generated 1596 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:11:14.608167 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-77b81aa1-3136-4b3e-81b9-1bf4631b9d8f tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:11:14.608725 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-77b81aa1-3136-4b3e-81b9-1bf4631b9d8f tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: c3ea23ca-a790-4f52-ad85-dcac640a8695] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:11:14.615124 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-77b81aa1-3136-4b3e-81b9-1bf4631b9d8f tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:14.615614 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-77b81aa1-3136-4b3e-81b9-1bf4631b9d8f tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:14.616445 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-77b81aa1-3136-4b3e-81b9-1bf4631b9d8f tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:14.616927 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-77b81aa1-3136-4b3e-81b9-1bf4631b9d8f tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:14.708254 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-77b81aa1-3136-4b3e-81b9-1bf4631b9d8f tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.104138 Jan 28 02:11:14.708989 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 423/806] 10.222.0.79 () {60 vars in 1315 bytes} [Fri Jan 28 02:11:14 2022] GET /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695/os-interface => generated 284 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 02:11:16.014939 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-4218165b-4eba-4817-9ebc-0981331139d7 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:11:16.016668 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-4218165b-4eba-4817-9ebc-0981331139d7 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: c3ea23ca-a790-4f52-ad85-dcac640a8695] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:11:16.025839 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-4218165b-4eba-4817-9ebc-0981331139d7 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:16.032633 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-4218165b-4eba-4817-9ebc-0981331139d7 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:16.032633 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-4218165b-4eba-4817-9ebc-0981331139d7 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:16.032633 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-4218165b-4eba-4817-9ebc-0981331139d7 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:16.041025 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [req-19c5ab76-48a9-4522-a402-ad5d28180735 req-985f7f57-38ca-4999-a2f4-c88acb21aa70 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3ea23ca-a790-4f52-ad85-dcac640a8695", "tag": "a5ba13e6-3134-4ccb-b060-70df55025709"}]} {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:11:16.042734 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:11:16.042734 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: warnings.warn(msg) Jan 28 02:11:16.054880 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [req-19c5ab76-48a9-4522-a402-ad5d28180735 req-985f7f57-38ca-4999-a2f4-c88acb21aa70 service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:16.055331 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [req-19c5ab76-48a9-4522-a402-ad5d28180735 req-985f7f57-38ca-4999-a2f4-c88acb21aa70 service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:16.075386 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.compute.server_external_events [req-19c5ab76-48a9-4522-a402-ad5d28180735 req-985f7f57-38ca-4999-a2f4-c88acb21aa70 service nova] Creating event network-changed:a5ba13e6-3134-4ccb-b060-70df55025709 for instance c3ea23ca-a790-4f52-ad85-dcac640a8695 on hv-cinder-82497 Jan 28 02:11:16.080731 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [req-19c5ab76-48a9-4522-a402-ad5d28180735 req-985f7f57-38ca-4999-a2f4-c88acb21aa70 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050888 Jan 28 02:11:16.084496 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 424/807] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Jan 28 02:11:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:11:16.162876 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-4218165b-4eba-4817-9ebc-0981331139d7 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "POST /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695/action" status: 200 len: 14 microversion: 2.20 time: 0.151710 Jan 28 02:11:16.164231 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 384/808] 10.222.0.79 () {62 vars in 1318 bytes} [Fri Jan 28 02:11:16 2022] POST /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695/action => generated 14 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:11:17.175461 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-8b582075-5ebe-45d5-b585-a12fdea311d1 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:11:17.179352 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-8b582075-5ebe-45d5-b585-a12fdea311d1 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: c3ea23ca-a790-4f52-ad85-dcac640a8695] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:11:17.183560 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-8b582075-5ebe-45d5-b585-a12fdea311d1 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:17.184380 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-8b582075-5ebe-45d5-b585-a12fdea311d1 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:17.185416 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-8b582075-5ebe-45d5-b585-a12fdea311d1 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:17.186062 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-8b582075-5ebe-45d5-b585-a12fdea311d1 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:17.291068 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-8b582075-5ebe-45d5-b585-a12fdea311d1 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "POST /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695/action" status: 200 len: 14 microversion: 2.20 time: 0.118876 Jan 28 02:11:17.294524 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 425/809] 10.222.0.79 () {62 vars in 1318 bytes} [Fri Jan 28 02:11:17 2022] POST /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695/action => generated 14 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:11:18.304293 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-5c56eff9-5620-47ce-a935-31c8befebc84 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:11:18.305300 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-5c56eff9-5620-47ce-a935-31c8befebc84 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: c3ea23ca-a790-4f52-ad85-dcac640a8695] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:11:18.314201 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-5c56eff9-5620-47ce-a935-31c8befebc84 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:18.314547 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-5c56eff9-5620-47ce-a935-31c8befebc84 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:18.315335 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-5c56eff9-5620-47ce-a935-31c8befebc84 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:18.315764 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-5c56eff9-5620-47ce-a935-31c8befebc84 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:18.411245 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-5c56eff9-5620-47ce-a935-31c8befebc84 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "POST /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695/action" status: 200 len: 14 microversion: 2.20 time: 0.111337 Jan 28 02:11:18.414193 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 385/810] 10.222.0.79 () {62 vars in 1318 bytes} [Fri Jan 28 02:11:18 2022] POST /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695/action => generated 14 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:11:19.432144 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-496bf2e1-376c-4621-8904-8375bd72c00f tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:11:19.433162 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-496bf2e1-376c-4621-8904-8375bd72c00f tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: c3ea23ca-a790-4f52-ad85-dcac640a8695] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:11:19.439943 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-496bf2e1-376c-4621-8904-8375bd72c00f tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:19.440427 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-496bf2e1-376c-4621-8904-8375bd72c00f tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:19.441286 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-496bf2e1-376c-4621-8904-8375bd72c00f tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:19.441728 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-496bf2e1-376c-4621-8904-8375bd72c00f tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:19.541045 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-496bf2e1-376c-4621-8904-8375bd72c00f tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "POST /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695/action" status: 200 len: 14 microversion: 2.20 time: 0.112452 Jan 28 02:11:19.542010 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 426/811] 10.222.0.79 () {62 vars in 1318 bytes} [Fri Jan 28 02:11:19 2022] POST /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695/action => generated 14 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:11:20.552874 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-b0bab35c-7be7-44bc-9302-ffec199432d0 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:11:20.553866 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-b0bab35c-7be7-44bc-9302-ffec199432d0 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: c3ea23ca-a790-4f52-ad85-dcac640a8695] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:11:20.562380 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b0bab35c-7be7-44bc-9302-ffec199432d0 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:20.563007 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b0bab35c-7be7-44bc-9302-ffec199432d0 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:20.563889 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b0bab35c-7be7-44bc-9302-ffec199432d0 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:20.564522 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b0bab35c-7be7-44bc-9302-ffec199432d0 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:21.950019 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-f59b8f93-6f35-4432-b51e-6d4acda7722e tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:11:21.951022 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-f59b8f93-6f35-4432-b51e-6d4acda7722e tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: d5f49055-da38-486c-9f10-1658c64d46f5] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:11:21.957916 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-f59b8f93-6f35-4432-b51e-6d4acda7722e tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:21.958370 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-f59b8f93-6f35-4432-b51e-6d4acda7722e tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:21.964686 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-f59b8f93-6f35-4432-b51e-6d4acda7722e tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:21.964686 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-f59b8f93-6f35-4432-b51e-6d4acda7722e tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:21.989107 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-f59b8f93-6f35-4432-b51e-6d4acda7722e tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "GET /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043446 Jan 28 02:11:21.989672 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 427/812] 10.222.0.79 () {58 vars in 1301 bytes} [Fri Jan 28 02:11:21 2022] GET /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 28 02:11:22.049374 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-54e75fe0-ed48-41f3-b3cc-46939643013e tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:11:22.049874 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-54e75fe0-ed48-41f3-b3cc-46939643013e tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: d5f49055-da38-486c-9f10-1658c64d46f5] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:11:22.056381 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-54e75fe0-ed48-41f3-b3cc-46939643013e tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:22.058869 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-54e75fe0-ed48-41f3-b3cc-46939643013e tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:22.058869 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-54e75fe0-ed48-41f3-b3cc-46939643013e tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:22.058869 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-54e75fe0-ed48-41f3-b3cc-46939643013e tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:22.082849 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-54e75fe0-ed48-41f3-b3cc-46939643013e tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: d5f49055-da38-486c-9f10-1658c64d46f5] Going to try to terminate instance {{(pid=116374) delete /opt/stack/nova/nova/compute/api.py:2612}} Jan 28 02:11:22.502802 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-54e75fe0-ed48-41f3-b3cc-46939643013e tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "DELETE /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5" status: 204 len: 0 microversion: 2.1 time: 0.456871 Jan 28 02:11:22.503390 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 428/813] 10.222.0.79 () {58 vars in 1238 bytes} [Fri Jan 28 02:11:22 2022] DELETE /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 28 02:11:22.512272 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-3d5460ea-e8a7-4189-b92d-f52fd509997e tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:11:22.512968 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-3d5460ea-e8a7-4189-b92d-f52fd509997e tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: d5f49055-da38-486c-9f10-1658c64d46f5] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:11:22.518652 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-3d5460ea-e8a7-4189-b92d-f52fd509997e tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:22.519095 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-3d5460ea-e8a7-4189-b92d-f52fd509997e tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:22.519858 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-3d5460ea-e8a7-4189-b92d-f52fd509997e tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:22.520322 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-3d5460ea-e8a7-4189-b92d-f52fd509997e tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:22.603336 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-b0bab35c-7be7-44bc-9302-ffec199432d0 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "POST /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695/action" status: 200 len: 14 microversion: 2.20 time: 2.054099 Jan 28 02:11:22.607351 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 386/814] 10.222.0.79 () {62 vars in 1318 bytes} [Fri Jan 28 02:11:20 2022] POST /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695/action => generated 14 bytes in 2057 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:11:22.920410 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-3d5460ea-e8a7-4189-b92d-f52fd509997e tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acab2a0c4a0e48909317791a3de85b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abe012ba65845329098e0e06c54b9c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:11:22.927659 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-3d5460ea-e8a7-4189-b92d-f52fd509997e tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "GET /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5" status: 200 len: 1673 microversion: 2.1 time: 0.419624 Jan 28 02:11:22.928260 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 429/815] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:11:22 2022] GET /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5 => generated 1673 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:11:23.615188 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-4d55f43c-3a25-427f-a22b-1dbca5d58572 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:11:23.616222 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-4d55f43c-3a25-427f-a22b-1dbca5d58572 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: c3ea23ca-a790-4f52-ad85-dcac640a8695] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:11:23.623825 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-4d55f43c-3a25-427f-a22b-1dbca5d58572 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:23.624385 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-4d55f43c-3a25-427f-a22b-1dbca5d58572 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:23.625169 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-4d55f43c-3a25-427f-a22b-1dbca5d58572 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:23.625598 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-4d55f43c-3a25-427f-a22b-1dbca5d58572 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:23.730206 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-4d55f43c-3a25-427f-a22b-1dbca5d58572 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "POST /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695/action" status: 200 len: 14 microversion: 2.20 time: 0.118763 Jan 28 02:11:23.731133 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 387/816] 10.222.0.79 () {62 vars in 1318 bytes} [Fri Jan 28 02:11:23 2022] POST /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695/action => generated 14 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:11:23.948772 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-28085e55-4a7d-48bb-929d-c0df5efec64b tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:11:23.949895 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-28085e55-4a7d-48bb-929d-c0df5efec64b tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: d5f49055-da38-486c-9f10-1658c64d46f5] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:11:23.956242 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-28085e55-4a7d-48bb-929d-c0df5efec64b tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:23.956695 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-28085e55-4a7d-48bb-929d-c0df5efec64b tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:23.957467 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-28085e55-4a7d-48bb-929d-c0df5efec64b tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:23.957896 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-28085e55-4a7d-48bb-929d-c0df5efec64b tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:24.080292 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-28085e55-4a7d-48bb-929d-c0df5efec64b tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acab2a0c4a0e48909317791a3de85b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abe012ba65845329098e0e06c54b9c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:11:24.088656 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-28085e55-4a7d-48bb-929d-c0df5efec64b tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "GET /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5" status: 200 len: 1673 microversion: 2.1 time: 0.145607 Jan 28 02:11:24.088998 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 430/817] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:11:23 2022] GET /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5 => generated 1673 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:11:24.742231 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-191c0729-8720-457e-a810-15e27a022194 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:11:24.744468 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-191c0729-8720-457e-a810-15e27a022194 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: c3ea23ca-a790-4f52-ad85-dcac640a8695] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:11:24.750969 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-191c0729-8720-457e-a810-15e27a022194 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:24.751419 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-191c0729-8720-457e-a810-15e27a022194 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:24.759153 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-191c0729-8720-457e-a810-15e27a022194 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:24.759153 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-191c0729-8720-457e-a810-15e27a022194 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:24.850193 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-191c0729-8720-457e-a810-15e27a022194 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "POST /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695/action" status: 200 len: 14 microversion: 2.20 time: 0.111860 Jan 28 02:11:24.853461 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 388/818] 10.222.0.79 () {62 vars in 1318 bytes} [Fri Jan 28 02:11:24 2022] POST /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695/action => generated 14 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:11:25.105838 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-dbdcd2aa-0109-40b1-86fb-8b42d9a7485c tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:11:25.106452 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-dbdcd2aa-0109-40b1-86fb-8b42d9a7485c tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: d5f49055-da38-486c-9f10-1658c64d46f5] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:11:25.114407 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-dbdcd2aa-0109-40b1-86fb-8b42d9a7485c tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:25.114861 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-dbdcd2aa-0109-40b1-86fb-8b42d9a7485c tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:25.115645 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-dbdcd2aa-0109-40b1-86fb-8b42d9a7485c tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:25.116146 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-dbdcd2aa-0109-40b1-86fb-8b42d9a7485c tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:25.238725 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-dbdcd2aa-0109-40b1-86fb-8b42d9a7485c tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acab2a0c4a0e48909317791a3de85b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abe012ba65845329098e0e06c54b9c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:11:25.246832 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-dbdcd2aa-0109-40b1-86fb-8b42d9a7485c tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "GET /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5" status: 200 len: 1673 microversion: 2.1 time: 0.144755 Jan 28 02:11:25.247405 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 431/819] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:11:25 2022] GET /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5 => generated 1673 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:11:25.861748 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-45051c37-5a39-44fa-af7a-f484ddb960ac tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:11:25.863324 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-45051c37-5a39-44fa-af7a-f484ddb960ac tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: c3ea23ca-a790-4f52-ad85-dcac640a8695] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:11:25.869838 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-45051c37-5a39-44fa-af7a-f484ddb960ac tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:25.870272 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-45051c37-5a39-44fa-af7a-f484ddb960ac tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:25.871257 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-45051c37-5a39-44fa-af7a-f484ddb960ac tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:25.871732 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-45051c37-5a39-44fa-af7a-f484ddb960ac tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:25.972533 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-45051c37-5a39-44fa-af7a-f484ddb960ac tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "POST /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695/action" status: 200 len: 14 microversion: 2.20 time: 0.114719 Jan 28 02:11:25.973196 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 389/820] 10.222.0.79 () {62 vars in 1318 bytes} [Fri Jan 28 02:11:25 2022] POST /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695/action => generated 14 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:11:26.263691 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-90b18c55-f91d-4235-a95d-56e249460db0 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:11:26.264330 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-90b18c55-f91d-4235-a95d-56e249460db0 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: d5f49055-da38-486c-9f10-1658c64d46f5] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:11:26.272898 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-90b18c55-f91d-4235-a95d-56e249460db0 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:26.272898 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-90b18c55-f91d-4235-a95d-56e249460db0 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:26.272898 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-90b18c55-f91d-4235-a95d-56e249460db0 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:26.272898 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-90b18c55-f91d-4235-a95d-56e249460db0 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:26.339790 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-90b18c55-f91d-4235-a95d-56e249460db0 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acab2a0c4a0e48909317791a3de85b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abe012ba65845329098e0e06c54b9c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:11:26.347471 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-90b18c55-f91d-4235-a95d-56e249460db0 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "GET /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5" status: 200 len: 1605 microversion: 2.1 time: 0.087192 Jan 28 02:11:26.347982 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 432/821] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:11:26 2022] GET /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5 => generated 1605 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:11:26.746079 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [req-683d7a4b-8256-426b-95af-98a0389057c6 req-55e769ca-7f7c-4325-b67d-851b66c7ade8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5f49055-da38-486c-9f10-1658c64d46f5", "name": "network-vif-deleted", "tag": "66c0ebdc-a262-49e8-983e-2b45feca212a"}]} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:11:26.748273 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:11:26.748273 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: warnings.warn(msg) Jan 28 02:11:26.757130 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-683d7a4b-8256-426b-95af-98a0389057c6 req-55e769ca-7f7c-4325-b67d-851b66c7ade8 service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:26.758147 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-683d7a4b-8256-426b-95af-98a0389057c6 req-55e769ca-7f7c-4325-b67d-851b66c7ade8 service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:26.772900 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.compute.server_external_events [req-683d7a4b-8256-426b-95af-98a0389057c6 req-55e769ca-7f7c-4325-b67d-851b66c7ade8 service nova] Creating event network-vif-deleted:66c0ebdc-a262-49e8-983e-2b45feca212a for instance d5f49055-da38-486c-9f10-1658c64d46f5 on hv-cinder-82497 Jan 28 02:11:26.782470 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [req-683d7a4b-8256-426b-95af-98a0389057c6 req-55e769ca-7f7c-4325-b67d-851b66c7ade8 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.281454 Jan 28 02:11:26.782470 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 390/822] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Jan 28 02:11:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:11:26.988712 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-292b384a-3558-40ac-a680-407a8ec64310 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:11:26.989977 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-292b384a-3558-40ac-a680-407a8ec64310 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: c3ea23ca-a790-4f52-ad85-dcac640a8695] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:11:26.998336 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-292b384a-3558-40ac-a680-407a8ec64310 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:26.999078 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-292b384a-3558-40ac-a680-407a8ec64310 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:27.000059 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-292b384a-3558-40ac-a680-407a8ec64310 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:27.001076 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-292b384a-3558-40ac-a680-407a8ec64310 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:27.125322 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-292b384a-3558-40ac-a680-407a8ec64310 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "POST /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695/action" status: 200 len: 5186 microversion: 2.20 time: 0.144839 Jan 28 02:11:27.126601 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 433/823] 10.222.0.79 () {62 vars in 1318 bytes} [Fri Jan 28 02:11:26 2022] POST /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695/action => generated 5186 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:11:27.367523 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-2da42d8a-5f37-4ce9-a6fd-8d1e6d4ce4b6 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:11:27.368705 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-2da42d8a-5f37-4ce9-a6fd-8d1e6d4ce4b6 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: d5f49055-da38-486c-9f10-1658c64d46f5] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:11:27.375580 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2da42d8a-5f37-4ce9-a6fd-8d1e6d4ce4b6 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:27.377038 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2da42d8a-5f37-4ce9-a6fd-8d1e6d4ce4b6 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:27.377830 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2da42d8a-5f37-4ce9-a6fd-8d1e6d4ce4b6 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:27.378701 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2da42d8a-5f37-4ce9-a6fd-8d1e6d4ce4b6 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:27.421494 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2da42d8a-5f37-4ce9-a6fd-8d1e6d4ce4b6 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:27.421946 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2da42d8a-5f37-4ce9-a6fd-8d1e6d4ce4b6 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:27.422400 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.objects.instance [None req-2da42d8a-5f37-4ce9-a6fd-8d1e6d4ce4b6 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lazy-loading 'fault' on Instance uuid d5f49055-da38-486c-9f10-1658c64d46f5 {{(pid=116375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jan 28 02:11:27.476780 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-2da42d8a-5f37-4ce9-a6fd-8d1e6d4ce4b6 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acab2a0c4a0e48909317791a3de85b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abe012ba65845329098e0e06c54b9c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:11:27.486431 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-2da42d8a-5f37-4ce9-a6fd-8d1e6d4ce4b6 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "GET /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5" status: 200 len: 1327 microversion: 2.1 time: 0.124499 Jan 28 02:11:27.487559 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 391/824] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:11:27 2022] GET /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5 => generated 1327 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:11:28.144136 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-ec989cae-4924-44ec-a2ff-560ab9d8d2cd tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:11:28.145126 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-ec989cae-4924-44ec-a2ff-560ab9d8d2cd tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: c3ea23ca-a790-4f52-ad85-dcac640a8695] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:11:28.155437 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-ec989cae-4924-44ec-a2ff-560ab9d8d2cd tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:28.156185 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-ec989cae-4924-44ec-a2ff-560ab9d8d2cd tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:28.157000 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-ec989cae-4924-44ec-a2ff-560ab9d8d2cd tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:28.157439 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-ec989cae-4924-44ec-a2ff-560ab9d8d2cd tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:28.271043 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-ec989cae-4924-44ec-a2ff-560ab9d8d2cd tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "POST /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695/action" status: 200 len: 13039 microversion: 2.20 time: 0.137546 Jan 28 02:11:28.271948 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 434/825] 10.222.0.79 () {62 vars in 1318 bytes} [Fri Jan 28 02:11:28 2022] POST /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695/action => generated 13039 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:11:28.504636 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-01f88e81-42ae-431c-9e0f-4b47fad20011 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:11:28.505269 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-01f88e81-42ae-431c-9e0f-4b47fad20011 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: d5f49055-da38-486c-9f10-1658c64d46f5] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:11:28.513179 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-01f88e81-42ae-431c-9e0f-4b47fad20011 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:28.513618 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-01f88e81-42ae-431c-9e0f-4b47fad20011 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:28.514379 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-01f88e81-42ae-431c-9e0f-4b47fad20011 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:28.514801 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-01f88e81-42ae-431c-9e0f-4b47fad20011 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:28.527789 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.wsgi [None req-01f88e81-42ae-431c-9e0f-4b47fad20011 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] HTTP exception thrown: Instance d5f49055-da38-486c-9f10-1658c64d46f5 could not be found. Jan 28 02:11:28.528396 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-01f88e81-42ae-431c-9e0f-4b47fad20011 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Returning 404 to user: Instance d5f49055-da38-486c-9f10-1658c64d46f5 could not be found. {{(pid=116375) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 02:11:28.529263 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-01f88e81-42ae-431c-9e0f-4b47fad20011 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "GET /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5" status: 404 len: 111 microversion: 2.1 time: 0.028287 Jan 28 02:11:28.529789 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 392/826] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:11:28 2022] GET /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 02:11:28.538615 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-773f7f55-bbc1-45a5-8502-28f21ac9921f tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Calling method '.version_select at 0x7f837c5b61f0>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:11:28.664089 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-773f7f55-bbc1-45a5-8502-28f21ac9921f tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1079325533" status: 202 len: 0 microversion: 2.1 time: 0.129363 Jan 28 02:11:28.664883 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 435/827] 10.222.0.79 () {58 vars in 1220 bytes} [Fri Jan 28 02:11:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1079325533 => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:11:29.282704 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-9a1f7051-71b4-49ed-96f4-d65e413b1382 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:11:29.283758 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-9a1f7051-71b4-49ed-96f4-d65e413b1382 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: c3ea23ca-a790-4f52-ad85-dcac640a8695] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:11:29.289681 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-9a1f7051-71b4-49ed-96f4-d65e413b1382 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:29.290124 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-9a1f7051-71b4-49ed-96f4-d65e413b1382 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:29.291446 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-9a1f7051-71b4-49ed-96f4-d65e413b1382 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:29.291873 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-9a1f7051-71b4-49ed-96f4-d65e413b1382 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:29.392449 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-9a1f7051-71b4-49ed-96f4-d65e413b1382 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "POST /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695/action" status: 200 len: 18449 microversion: 2.20 time: 0.113218 Jan 28 02:11:29.393136 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 393/828] 10.222.0.79 () {62 vars in 1318 bytes} [Fri Jan 28 02:11:29 2022] POST /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695/action => generated 18449 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:11:29.655677 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-5f2cd2d3-08df-433d-a5cb-67a39d5b175e tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Action: 'create', calling method: .version_select at 0x7f837c3f1430>, body: {"keypair": {"name": "tempest-keypair-903375684"}} {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:11:29.674323 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.quota [None req-5f2cd2d3-08df-433d-a5cb-67a39d5b175e tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Getting quotas for project 0abe012ba65845329098e0e06c54b9c1. Resources: {'key_pairs'} {{(pid=116374) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 02:11:29.678425 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.quota [None req-5f2cd2d3-08df-433d-a5cb-67a39d5b175e tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Getting quotas for user acab2a0c4a0e48909317791a3de85b53 and project 0abe012ba65845329098e0e06c54b9c1. Resources: {'key_pairs'} {{(pid=116374) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 02:11:29.863079 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.quota [None req-5f2cd2d3-08df-433d-a5cb-67a39d5b175e tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Getting quotas for project 0abe012ba65845329098e0e06c54b9c1. Resources: {'key_pairs'} {{(pid=116374) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 02:11:29.866733 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.quota [None req-5f2cd2d3-08df-433d-a5cb-67a39d5b175e tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Getting quotas for user acab2a0c4a0e48909317791a3de85b53 and project 0abe012ba65845329098e0e06c54b9c1. Resources: {'key_pairs'} {{(pid=116374) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 02:11:29.879586 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-5f2cd2d3-08df-433d-a5cb-67a39d5b175e tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 0.227713 Jan 28 02:11:29.880208 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 436/829] 10.222.0.79 () {60 vars in 1157 bytes} [Fri Jan 28 02:11:29 2022] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:11:30.404882 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-caee42a3-cd27-4792-8378-d1271f5d337a tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:11:30.405958 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-caee42a3-cd27-4792-8378-d1271f5d337a tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: c3ea23ca-a790-4f52-ad85-dcac640a8695] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:11:30.412617 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-caee42a3-cd27-4792-8378-d1271f5d337a tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:30.413059 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-caee42a3-cd27-4792-8378-d1271f5d337a tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:30.413826 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-caee42a3-cd27-4792-8378-d1271f5d337a tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:30.414255 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-caee42a3-cd27-4792-8378-d1271f5d337a tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:30.508769 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-caee42a3-cd27-4792-8378-d1271f5d337a tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "POST /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695/action" status: 200 len: 19133 microversion: 2.20 time: 0.107921 Jan 28 02:11:30.509392 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 394/830] 10.222.0.79 () {62 vars in 1318 bytes} [Fri Jan 28 02:11:30 2022] POST /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695/action => generated 19133 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:11:31.521664 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-c94a42c7-93df-4898-90b1-37ce906be26a tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:11:31.522899 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-c94a42c7-93df-4898-90b1-37ce906be26a tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: c3ea23ca-a790-4f52-ad85-dcac640a8695] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:11:31.530110 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-c94a42c7-93df-4898-90b1-37ce906be26a tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:31.530558 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-c94a42c7-93df-4898-90b1-37ce906be26a tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:31.531332 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-c94a42c7-93df-4898-90b1-37ce906be26a tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:31.531767 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-c94a42c7-93df-4898-90b1-37ce906be26a tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:31.641779 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-c94a42c7-93df-4898-90b1-37ce906be26a tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "POST /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695/action" status: 200 len: 21344 microversion: 2.20 time: 0.123850 Jan 28 02:11:31.642428 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 437/831] 10.222.0.79 () {62 vars in 1318 bytes} [Fri Jan 28 02:11:31 2022] POST /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695/action => generated 21344 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:11:32.655032 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-3e218030-50cf-4dca-b88f-98a0458b7d5e tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:11:32.656053 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-3e218030-50cf-4dca-b88f-98a0458b7d5e tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: c3ea23ca-a790-4f52-ad85-dcac640a8695] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:11:32.662826 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-3e218030-50cf-4dca-b88f-98a0458b7d5e tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:32.663563 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-3e218030-50cf-4dca-b88f-98a0458b7d5e tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:32.664367 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-3e218030-50cf-4dca-b88f-98a0458b7d5e tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:32.664817 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-3e218030-50cf-4dca-b88f-98a0458b7d5e tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:32.778474 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-3e218030-50cf-4dca-b88f-98a0458b7d5e tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "POST /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695/action" status: 200 len: 23045 microversion: 2.20 time: 0.125771 Jan 28 02:11:32.783265 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 395/832] 10.222.0.79 () {62 vars in 1318 bytes} [Fri Jan 28 02:11:32 2022] POST /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695/action => generated 23045 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 28 02:11:33.430517 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-2321b601-ff2a-4c51-bff9-ec0f2f121c2d tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2082162896", "imageRef": "04805ce8-b0a0-41b2-b614-bfb5b752cc5d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3b3748b7-1bed-4ab4-9fea-64d92f6154dd"}], "security_groups": [{"name": "tempest-securitygroup--1638754022"}], "key_name": "tempest-keypair-903375684", "user_data": "}} {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:11:33.542772 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.network.neutron [None req-2321b601-ff2a-4c51-bff9-ec0f2f121c2d tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] validate_networks() for [('3b3748b7-1bed-4ab4-9fea-64d92f6154dd', None, None, None, None, None)] {{(pid=116374) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Jan 28 02:11:33.792115 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-e21ebe20-d583-433a-88ce-b5b3544a53e7 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:11:33.793908 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-e21ebe20-d583-433a-88ce-b5b3544a53e7 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: c3ea23ca-a790-4f52-ad85-dcac640a8695] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:11:33.810437 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-e21ebe20-d583-433a-88ce-b5b3544a53e7 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:33.810922 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-e21ebe20-d583-433a-88ce-b5b3544a53e7 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:33.812100 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-e21ebe20-d583-433a-88ce-b5b3544a53e7 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:33.812532 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-e21ebe20-d583-433a-88ce-b5b3544a53e7 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:33.935749 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-e21ebe20-d583-433a-88ce-b5b3544a53e7 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "POST /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695/action" status: 200 len: 24302 microversion: 2.20 time: 0.148261 Jan 28 02:11:33.942177 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 396/833] 10.222.0.79 () {62 vars in 1318 bytes} [Fri Jan 28 02:11:33 2022] POST /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695/action => generated 24302 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 28 02:11:34.205803 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.virt.hardware [None req-2321b601-ff2a-4c51-bff9-ec0f2f121c2d tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Flavor limits 0:0:0 {{(pid=116374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 02:11:34.206518 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.virt.hardware [None req-2321b601-ff2a-4c51-bff9-ec0f2f121c2d tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Image limits 0:0:0 {{(pid=116374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 02:11:34.207055 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.virt.hardware [None req-2321b601-ff2a-4c51-bff9-ec0f2f121c2d tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Flavor pref 0:0:0 {{(pid=116374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 02:11:34.208113 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.virt.hardware [None req-2321b601-ff2a-4c51-bff9-ec0f2f121c2d tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Image pref 0:0:0 {{(pid=116374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 02:11:34.208776 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.virt.hardware [None req-2321b601-ff2a-4c51-bff9-ec0f2f121c2d tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 02:11:34.218165 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-2321b601-ff2a-4c51-bff9-ec0f2f121c2d tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:34.218923 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-2321b601-ff2a-4c51-bff9-ec0f2f121c2d tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:34.219804 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-2321b601-ff2a-4c51-bff9-ec0f2f121c2d tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:34.220341 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-2321b601-ff2a-4c51-bff9-ec0f2f121c2d tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:34.239046 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.quota [None req-2321b601-ff2a-4c51-bff9-ec0f2f121c2d tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Getting quotas for project 0abe012ba65845329098e0e06c54b9c1. Resources: {'ram', 'cores', 'instances'} {{(pid=116374) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 02:11:34.243736 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.quota [None req-2321b601-ff2a-4c51-bff9-ec0f2f121c2d tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Getting quotas for user acab2a0c4a0e48909317791a3de85b53 and project 0abe012ba65845329098e0e06c54b9c1. Resources: {'ram', 'cores', 'instances'} {{(pid=116374) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 02:11:34.258723 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-2321b601-ff2a-4c51-bff9-ec0f2f121c2d tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Going to run 1 instances... {{(pid=116374) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 02:11:34.258723 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-2321b601-ff2a-4c51-bff9-ec0f2f121c2d tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='04805ce8-b0a0-41b2-b614-bfb5b752cc5d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116374) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 02:11:34.369986 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-2321b601-ff2a-4c51-bff9-ec0f2f121c2d tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.943725 Jan 28 02:11:34.372273 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 438/834] 10.222.0.79 () {60 vars in 1146 bytes} [Fri Jan 28 02:11:33 2022] POST /compute/v2.1/servers => generated 402 bytes in 947 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 28 02:11:34.381535 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-d4f03e5c-781b-4a0a-8e9e-41e9790f07d5 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:11:34.382211 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-d4f03e5c-781b-4a0a-8e9e-41e9790f07d5 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:11:34.467386 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-d4f03e5c-781b-4a0a-8e9e-41e9790f07d5 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acab2a0c4a0e48909317791a3de85b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abe012ba65845329098e0e06c54b9c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:11:34.475339 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-d4f03e5c-781b-4a0a-8e9e-41e9790f07d5 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "GET /compute/v2.1/servers/ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc" status: 200 len: 1237 microversion: 2.1 time: 0.097747 Jan 28 02:11:34.477670 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 397/835] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:11:34 2022] GET /compute/v2.1/servers/ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc => generated 1237 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:11:34.949888 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-fc2af220-9372-4351-8ff1-db54eda53ac5 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:11:34.950868 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-fc2af220-9372-4351-8ff1-db54eda53ac5 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: c3ea23ca-a790-4f52-ad85-dcac640a8695] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:11:34.957062 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-fc2af220-9372-4351-8ff1-db54eda53ac5 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:34.957503 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-fc2af220-9372-4351-8ff1-db54eda53ac5 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:34.958270 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-fc2af220-9372-4351-8ff1-db54eda53ac5 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:34.958866 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-fc2af220-9372-4351-8ff1-db54eda53ac5 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:35.095924 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-fc2af220-9372-4351-8ff1-db54eda53ac5 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "POST /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695/action" status: 200 len: 25654 microversion: 2.20 time: 0.149436 Jan 28 02:11:35.098834 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 439/836] 10.222.0.79 () {62 vars in 1318 bytes} [Fri Jan 28 02:11:34 2022] POST /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695/action => generated 25654 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:11:35.493826 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-cf43af2a-9f3b-47ee-b24e-88d02f510c85 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:11:35.495607 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-cf43af2a-9f3b-47ee-b24e-88d02f510c85 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:11:35.580335 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-cf43af2a-9f3b-47ee-b24e-88d02f510c85 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acab2a0c4a0e48909317791a3de85b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abe012ba65845329098e0e06c54b9c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:11:35.589118 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-cf43af2a-9f3b-47ee-b24e-88d02f510c85 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "GET /compute/v2.1/servers/ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc" status: 200 len: 1237 microversion: 2.1 time: 0.098558 Jan 28 02:11:35.590068 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 398/837] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:11:35 2022] GET /compute/v2.1/servers/ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc => generated 1237 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:11:36.113371 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-a9ec4a59-db17-47b0-a230-2480694ffe85 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:11:36.115047 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-a9ec4a59-db17-47b0-a230-2480694ffe85 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: c3ea23ca-a790-4f52-ad85-dcac640a8695] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:11:36.123717 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-a9ec4a59-db17-47b0-a230-2480694ffe85 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:36.124553 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-a9ec4a59-db17-47b0-a230-2480694ffe85 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:36.125402 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-a9ec4a59-db17-47b0-a230-2480694ffe85 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:36.126102 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-a9ec4a59-db17-47b0-a230-2480694ffe85 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:36.250121 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-a9ec4a59-db17-47b0-a230-2480694ffe85 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "POST /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695/action" status: 200 len: 27030 microversion: 2.20 time: 0.141682 Jan 28 02:11:36.254084 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 440/838] 10.222.0.79 () {62 vars in 1318 bytes} [Fri Jan 28 02:11:36 2022] POST /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695/action => generated 27030 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:11:36.607463 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-5728efa1-d9df-430d-b628-c3fcbb3213b9 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:11:36.608187 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-5728efa1-d9df-430d-b628-c3fcbb3213b9 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:11:36.621850 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-5728efa1-d9df-430d-b628-c3fcbb3213b9 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:36.623090 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-5728efa1-d9df-430d-b628-c3fcbb3213b9 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:36.623376 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-5728efa1-d9df-430d-b628-c3fcbb3213b9 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:36.623941 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-5728efa1-d9df-430d-b628-c3fcbb3213b9 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:36.696458 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-5728efa1-d9df-430d-b628-c3fcbb3213b9 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acab2a0c4a0e48909317791a3de85b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abe012ba65845329098e0e06c54b9c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:11:36.705007 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-5728efa1-d9df-430d-b628-c3fcbb3213b9 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "GET /compute/v2.1/servers/ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc" status: 200 len: 1289 microversion: 2.1 time: 0.102051 Jan 28 02:11:36.705627 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 399/839] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:11:36 2022] GET /compute/v2.1/servers/ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc => generated 1289 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:11:37.262109 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-c23bde28-123a-4266-b9de-2a77fbbb0fba tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:11:37.269549 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-c23bde28-123a-4266-b9de-2a77fbbb0fba tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: c3ea23ca-a790-4f52-ad85-dcac640a8695] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:11:37.282003 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-c23bde28-123a-4266-b9de-2a77fbbb0fba tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:37.283150 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-c23bde28-123a-4266-b9de-2a77fbbb0fba tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:37.285428 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-c23bde28-123a-4266-b9de-2a77fbbb0fba tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:37.287716 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-c23bde28-123a-4266-b9de-2a77fbbb0fba tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:37.440645 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-c23bde28-123a-4266-b9de-2a77fbbb0fba tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "POST /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695/action" status: 200 len: 27784 microversion: 2.20 time: 0.181885 Jan 28 02:11:37.450003 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 441/840] 10.222.0.79 () {62 vars in 1318 bytes} [Fri Jan 28 02:11:37 2022] POST /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695/action => generated 27784 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:11:37.723412 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-88d6a8fc-257e-439d-9be3-cfb4993015df tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:11:37.724624 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-88d6a8fc-257e-439d-9be3-cfb4993015df tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:11:37.733535 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-88d6a8fc-257e-439d-9be3-cfb4993015df tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:37.734159 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-88d6a8fc-257e-439d-9be3-cfb4993015df tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:37.735244 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-88d6a8fc-257e-439d-9be3-cfb4993015df tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:37.735680 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-88d6a8fc-257e-439d-9be3-cfb4993015df tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:37.822843 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-88d6a8fc-257e-439d-9be3-cfb4993015df tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acab2a0c4a0e48909317791a3de85b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abe012ba65845329098e0e06c54b9c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:11:37.832436 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-88d6a8fc-257e-439d-9be3-cfb4993015df tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "GET /compute/v2.1/servers/ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc" status: 200 len: 1295 microversion: 2.1 time: 0.113410 Jan 28 02:11:37.843955 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 400/841] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:11:37 2022] GET /compute/v2.1/servers/ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc => generated 1295 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:11:38.214890 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-cad7f246-e348-4691-bdcd-a37d891561fc tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-702916367"}} {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:11:38.215822 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-cad7f246-e348-4691-bdcd-a37d891561fc tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] [instance: 086c6296-168f-46fc-9ec4-8700b7c6ca9f] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:11:38.228883 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-cad7f246-e348-4691-bdcd-a37d891561fc tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:38.232236 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-cad7f246-e348-4691-bdcd-a37d891561fc tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:38.235142 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-cad7f246-e348-4691-bdcd-a37d891561fc tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:38.236709 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-cad7f246-e348-4691-bdcd-a37d891561fc tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:38.415795 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.network.security_group_api [None req-cad7f246-e348-4691-bdcd-a37d891561fc tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Removing security group 843a7a38-8512-47d0-ac6e-f19ff26f1d0c from port deb20626-b237-4650-a93b-12a633f6daa5 Jan 28 02:11:38.459210 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-8574dcea-f88e-408a-9b8e-5a9bff401353 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:11:38.460365 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-8574dcea-f88e-408a-9b8e-5a9bff401353 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: c3ea23ca-a790-4f52-ad85-dcac640a8695] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:11:38.473812 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-8574dcea-f88e-408a-9b8e-5a9bff401353 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:38.484134 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-8574dcea-f88e-408a-9b8e-5a9bff401353 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:38.484134 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-8574dcea-f88e-408a-9b8e-5a9bff401353 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:38.484134 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-8574dcea-f88e-408a-9b8e-5a9bff401353 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:38.610611 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-8574dcea-f88e-408a-9b8e-5a9bff401353 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "POST /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695/action" status: 200 len: 28262 microversion: 2.20 time: 0.160348 Jan 28 02:11:38.611255 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 401/842] 10.222.0.79 () {62 vars in 1318 bytes} [Fri Jan 28 02:11:38 2022] POST /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695/action => generated 28262 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:11:38.851550 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-1afc958a-85a2-4901-8493-83bb5d784350 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:11:38.854743 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-1afc958a-85a2-4901-8493-83bb5d784350 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:11:38.865784 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-1afc958a-85a2-4901-8493-83bb5d784350 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:38.867528 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-1afc958a-85a2-4901-8493-83bb5d784350 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:38.870895 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-1afc958a-85a2-4901-8493-83bb5d784350 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:38.872238 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-1afc958a-85a2-4901-8493-83bb5d784350 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:39.444521 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-1afc958a-85a2-4901-8493-83bb5d784350 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acab2a0c4a0e48909317791a3de85b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abe012ba65845329098e0e06c54b9c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:11:39.451048 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-1afc958a-85a2-4901-8493-83bb5d784350 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "GET /compute/v2.1/servers/ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc" status: 200 len: 1363 microversion: 2.1 time: 0.604079 Jan 28 02:11:39.452060 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 402/843] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:11:38 2022] GET /compute/v2.1/servers/ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc => generated 1363 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:11:39.624462 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-366edec3-9a70-497c-8852-b32c94287e15 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:11:39.627646 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-366edec3-9a70-497c-8852-b32c94287e15 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: c3ea23ca-a790-4f52-ad85-dcac640a8695] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:11:39.638270 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-366edec3-9a70-497c-8852-b32c94287e15 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:39.640565 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-366edec3-9a70-497c-8852-b32c94287e15 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:39.642829 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-366edec3-9a70-497c-8852-b32c94287e15 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:39.644992 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-366edec3-9a70-497c-8852-b32c94287e15 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:39.705603 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-cad7f246-e348-4691-bdcd-a37d891561fc tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] 10.222.0.79 "POST /compute/v2.1/servers/086c6296-168f-46fc-9ec4-8700b7c6ca9f/action" status: 202 len: 0 microversion: 2.1 time: 1.496326 Jan 28 02:11:39.710993 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 442/844] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Jan 28 02:11:38 2022] POST /compute/v2.1/servers/086c6296-168f-46fc-9ec4-8700b7c6ca9f/action => generated 0 bytes in 1502 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:11:39.742725 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [req-f2432310-4d64-4738-97a9-c2b1995f4b2c req-aa214fa8-bb50-4cda-952e-bef8cca8e324 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "086c6296-168f-46fc-9ec4-8700b7c6ca9f", "tag": "deb20626-b237-4650-a93b-12a633f6daa5"}]} {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:11:39.750903 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:11:39.750903 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: warnings.warn(msg) Jan 28 02:11:39.767077 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [req-f2432310-4d64-4738-97a9-c2b1995f4b2c req-aa214fa8-bb50-4cda-952e-bef8cca8e324 service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:39.767526 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [req-f2432310-4d64-4738-97a9-c2b1995f4b2c req-aa214fa8-bb50-4cda-952e-bef8cca8e324 service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:39.805858 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.compute.server_external_events [req-f2432310-4d64-4738-97a9-c2b1995f4b2c req-aa214fa8-bb50-4cda-952e-bef8cca8e324 service nova] Creating event network-changed:deb20626-b237-4650-a93b-12a633f6daa5 for instance 086c6296-168f-46fc-9ec4-8700b7c6ca9f on hv-cinder-82497 Jan 28 02:11:39.837537 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [req-f2432310-4d64-4738-97a9-c2b1995f4b2c req-aa214fa8-bb50-4cda-952e-bef8cca8e324 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104828 Jan 28 02:11:39.838776 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 443/845] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Jan 28 02:11:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:11:39.868446 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-366edec3-9a70-497c-8852-b32c94287e15 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "POST /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695/action" status: 200 len: 28264 microversion: 2.20 time: 0.242680 Jan 28 02:11:39.868446 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 403/846] 10.222.0.79 () {62 vars in 1318 bytes} [Fri Jan 28 02:11:39 2022] POST /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695/action => generated 28264 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:11:40.473037 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-d019f799-8ab2-433e-b9a4-20809ebc6b52 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:11:40.473037 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-d019f799-8ab2-433e-b9a4-20809ebc6b52 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:11:40.480642 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-d019f799-8ab2-433e-b9a4-20809ebc6b52 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:40.481484 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-d019f799-8ab2-433e-b9a4-20809ebc6b52 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:40.482647 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-d019f799-8ab2-433e-b9a4-20809ebc6b52 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:40.483636 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-d019f799-8ab2-433e-b9a4-20809ebc6b52 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:40.880446 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-b16e8808-8567-46ce-bdb1-24accb550d4c tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:11:40.880446 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-b16e8808-8567-46ce-bdb1-24accb550d4c tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: c3ea23ca-a790-4f52-ad85-dcac640a8695] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:11:40.918632 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b16e8808-8567-46ce-bdb1-24accb550d4c tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:40.923058 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b16e8808-8567-46ce-bdb1-24accb550d4c tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:40.923058 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b16e8808-8567-46ce-bdb1-24accb550d4c tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:40.925228 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b16e8808-8567-46ce-bdb1-24accb550d4c tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:41.076080 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-b16e8808-8567-46ce-bdb1-24accb550d4c tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "POST /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695/action" status: 200 len: 28264 microversion: 2.20 time: 0.204517 Jan 28 02:11:41.076630 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 404/847] 10.222.0.79 () {62 vars in 1318 bytes} [Fri Jan 28 02:11:40 2022] POST /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695/action => generated 28264 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:11:41.165231 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-d019f799-8ab2-433e-b9a4-20809ebc6b52 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acab2a0c4a0e48909317791a3de85b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abe012ba65845329098e0e06c54b9c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:11:41.189000 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-d019f799-8ab2-433e-b9a4-20809ebc6b52 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "GET /compute/v2.1/servers/ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc" status: 200 len: 1363 microversion: 2.1 time: 0.714969 Jan 28 02:11:41.191059 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 444/848] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:11:40 2022] GET /compute/v2.1/servers/ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc => generated 1363 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:11:41.894943 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [req-fb7bf0bb-8658-4bb2-8666-3649042e9c2a req-0e01ca4f-86c6-41f9-a188-fb084d13b140 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc", "tag": "3247d8ae-933f-49e6-9365-3da79500309f"}]} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:11:41.901588 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:11:41.901588 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: warnings.warn(msg) Jan 28 02:11:41.913898 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-fb7bf0bb-8658-4bb2-8666-3649042e9c2a req-0e01ca4f-86c6-41f9-a188-fb084d13b140 service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:41.917075 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-fb7bf0bb-8658-4bb2-8666-3649042e9c2a req-0e01ca4f-86c6-41f9-a188-fb084d13b140 service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:41.932443 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.compute.server_external_events [req-fb7bf0bb-8658-4bb2-8666-3649042e9c2a req-0e01ca4f-86c6-41f9-a188-fb084d13b140 service nova] Creating event network-changed:3247d8ae-933f-49e6-9365-3da79500309f for instance ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc on hv-cinder-82497 Jan 28 02:11:41.940758 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [req-fb7bf0bb-8658-4bb2-8666-3649042e9c2a req-0e01ca4f-86c6-41f9-a188-fb084d13b140 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053143 Jan 28 02:11:41.942182 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 405/849] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Jan 28 02:11:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:11:42.088847 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-244233af-d8ae-434c-a620-ba3ce087b481 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:11:42.090425 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-244233af-d8ae-434c-a620-ba3ce087b481 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: c3ea23ca-a790-4f52-ad85-dcac640a8695] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:11:42.097935 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-244233af-d8ae-434c-a620-ba3ce087b481 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:42.098325 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-244233af-d8ae-434c-a620-ba3ce087b481 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:42.099384 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-244233af-d8ae-434c-a620-ba3ce087b481 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:42.100204 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-244233af-d8ae-434c-a620-ba3ce087b481 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:42.207264 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-8a34ae73-18ea-45cf-9eee-c7a71078fc7f tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:11:42.208063 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-8a34ae73-18ea-45cf-9eee-c7a71078fc7f tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:11:42.215907 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-8a34ae73-18ea-45cf-9eee-c7a71078fc7f tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:42.216628 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-8a34ae73-18ea-45cf-9eee-c7a71078fc7f tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:42.217625 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-8a34ae73-18ea-45cf-9eee-c7a71078fc7f tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:42.218162 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-8a34ae73-18ea-45cf-9eee-c7a71078fc7f tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:42.218511 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-244233af-d8ae-434c-a620-ba3ce087b481 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "POST /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695/action" status: 200 len: 28555 microversion: 2.20 time: 0.133368 Jan 28 02:11:42.219511 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 445/850] 10.222.0.79 () {62 vars in 1318 bytes} [Fri Jan 28 02:11:42 2022] POST /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695/action => generated 28555 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:11:42.371255 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-8a34ae73-18ea-45cf-9eee-c7a71078fc7f tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acab2a0c4a0e48909317791a3de85b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abe012ba65845329098e0e06c54b9c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:11:42.379874 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-8a34ae73-18ea-45cf-9eee-c7a71078fc7f tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "GET /compute/v2.1/servers/ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc" status: 200 len: 1363 microversion: 2.1 time: 0.176761 Jan 28 02:11:42.381114 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 406/851] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:11:42 2022] GET /compute/v2.1/servers/ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc => generated 1363 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:11:42.598158 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-87d1d124-a085-4e05-9c2a-c1815db5a73c tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:11:42.598736 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-87d1d124-a085-4e05-9c2a-c1815db5a73c tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] [instance: 086c6296-168f-46fc-9ec4-8700b7c6ca9f] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:11:42.609382 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-87d1d124-a085-4e05-9c2a-c1815db5a73c tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:42.609836 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-87d1d124-a085-4e05-9c2a-c1815db5a73c tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:42.610632 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-87d1d124-a085-4e05-9c2a-c1815db5a73c tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:42.624681 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-87d1d124-a085-4e05-9c2a-c1815db5a73c tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:42.781989 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.objects.instance [None req-87d1d124-a085-4e05-9c2a-c1815db5a73c tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lazy-loading 'services' on Instance uuid 086c6296-168f-46fc-9ec4-8700b7c6ca9f {{(pid=116374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jan 28 02:11:42.865268 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [req-64865b54-c24c-4d8a-a18e-5c3c9b75733a req-3b8a686c-14f3-4f30-9604-e76b09a18e3f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "086c6296-168f-46fc-9ec4-8700b7c6ca9f", "tag": "deb20626-b237-4650-a93b-12a633f6daa5"}]} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:11:42.867851 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:11:42.867851 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: warnings.warn(msg) Jan 28 02:11:42.879229 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-64865b54-c24c-4d8a-a18e-5c3c9b75733a req-3b8a686c-14f3-4f30-9604-e76b09a18e3f service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:42.880401 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-64865b54-c24c-4d8a-a18e-5c3c9b75733a req-3b8a686c-14f3-4f30-9604-e76b09a18e3f service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:42.895269 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.compute.server_external_events [req-64865b54-c24c-4d8a-a18e-5c3c9b75733a req-3b8a686c-14f3-4f30-9604-e76b09a18e3f service nova] Creating event network-changed:deb20626-b237-4650-a93b-12a633f6daa5 for instance 086c6296-168f-46fc-9ec4-8700b7c6ca9f on hv-cinder-82497 Jan 28 02:11:42.903150 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [req-64865b54-c24c-4d8a-a18e-5c3c9b75733a req-3b8a686c-14f3-4f30-9604-e76b09a18e3f service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.304080 Jan 28 02:11:42.904343 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 407/852] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Jan 28 02:11:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 02:11:43.058828 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-87d1d124-a085-4e05-9c2a-c1815db5a73c tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] 10.222.0.79 "DELETE /compute/v2.1/servers/086c6296-168f-46fc-9ec4-8700b7c6ca9f/os-volume_attachments/e4ea420f-5a33-45f1-a33f-a7f1253addd2" status: 202 len: 0 microversion: 2.1 time: 0.464523 Jan 28 02:11:43.060610 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 446/853] 10.222.0.79 () {58 vars in 1415 bytes} [Fri Jan 28 02:11:42 2022] DELETE /compute/v2.1/servers/086c6296-168f-46fc-9ec4-8700b7c6ca9f/os-volume_attachments/e4ea420f-5a33-45f1-a33f-a7f1253addd2 => generated 0 bytes in 468 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:11:43.080228 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-9b253ca3-8a31-4e32-9c1e-6fc4872c44d6 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:11:43.082667 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-9b253ca3-8a31-4e32-9c1e-6fc4872c44d6 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] [instance: 086c6296-168f-46fc-9ec4-8700b7c6ca9f] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:11:43.104216 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-9b253ca3-8a31-4e32-9c1e-6fc4872c44d6 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:43.105249 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-9b253ca3-8a31-4e32-9c1e-6fc4872c44d6 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:43.106353 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-9b253ca3-8a31-4e32-9c1e-6fc4872c44d6 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:43.107007 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-9b253ca3-8a31-4e32-9c1e-6fc4872c44d6 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:43.167383 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-9b253ca3-8a31-4e32-9c1e-6fc4872c44d6 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] 10.222.0.79 "GET /compute/v2.1/servers/086c6296-168f-46fc-9ec4-8700b7c6ca9f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.102165 Jan 28 02:11:43.169052 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 408/854] 10.222.0.79 () {58 vars in 1301 bytes} [Fri Jan 28 02:11:43 2022] GET /compute/v2.1/servers/086c6296-168f-46fc-9ec4-8700b7c6ca9f/os-volume_attachments => generated 197 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:11:43.234778 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-d03e41f5-ed52-4cc7-b0e6-8c0bfd270cfa tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:11:43.236465 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-d03e41f5-ed52-4cc7-b0e6-8c0bfd270cfa tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: c3ea23ca-a790-4f52-ad85-dcac640a8695] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:11:43.243289 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-d03e41f5-ed52-4cc7-b0e6-8c0bfd270cfa tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:43.244682 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-d03e41f5-ed52-4cc7-b0e6-8c0bfd270cfa tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:43.245992 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-d03e41f5-ed52-4cc7-b0e6-8c0bfd270cfa tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:43.246421 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-d03e41f5-ed52-4cc7-b0e6-8c0bfd270cfa tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:43.372209 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-d03e41f5-ed52-4cc7-b0e6-8c0bfd270cfa tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "POST /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695/action" status: 200 len: 28723 microversion: 2.20 time: 0.144809 Jan 28 02:11:43.376286 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 447/855] 10.222.0.79 () {62 vars in 1318 bytes} [Fri Jan 28 02:11:43 2022] POST /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695/action => generated 28723 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:11:43.397716 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-e97fd498-90ae-4c9f-b80b-19b3c3954af2 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:11:43.398328 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-e97fd498-90ae-4c9f-b80b-19b3c3954af2 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:11:43.418591 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-e97fd498-90ae-4c9f-b80b-19b3c3954af2 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:43.419037 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-e97fd498-90ae-4c9f-b80b-19b3c3954af2 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:43.420245 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-e97fd498-90ae-4c9f-b80b-19b3c3954af2 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:43.421244 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-e97fd498-90ae-4c9f-b80b-19b3c3954af2 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:44.179511 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-ecc404e1-2778-4f3e-9cde-ff0f2346a860 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:11:44.180910 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-ecc404e1-2778-4f3e-9cde-ff0f2346a860 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] [instance: 086c6296-168f-46fc-9ec4-8700b7c6ca9f] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:11:44.194406 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-ecc404e1-2778-4f3e-9cde-ff0f2346a860 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:44.195139 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-ecc404e1-2778-4f3e-9cde-ff0f2346a860 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:44.201685 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-ecc404e1-2778-4f3e-9cde-ff0f2346a860 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:44.204450 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-ecc404e1-2778-4f3e-9cde-ff0f2346a860 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:44.218982 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-e97fd498-90ae-4c9f-b80b-19b3c3954af2 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acab2a0c4a0e48909317791a3de85b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abe012ba65845329098e0e06c54b9c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:11:44.221691 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-e97fd498-90ae-4c9f-b80b-19b3c3954af2 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "GET /compute/v2.1/servers/ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc" status: 200 len: 1363 microversion: 2.1 time: 0.827993 Jan 28 02:11:44.224106 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 409/856] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:11:43 2022] GET /compute/v2.1/servers/ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc => generated 1363 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:11:44.268812 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-ecc404e1-2778-4f3e-9cde-ff0f2346a860 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] 10.222.0.79 "GET /compute/v2.1/servers/086c6296-168f-46fc-9ec4-8700b7c6ca9f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.093723 Jan 28 02:11:44.269640 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 448/857] 10.222.0.79 () {58 vars in 1301 bytes} [Fri Jan 28 02:11:44 2022] GET /compute/v2.1/servers/086c6296-168f-46fc-9ec4-8700b7c6ca9f/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:11:44.386073 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-8b75c10b-80dd-4b02-940f-03965d20170b tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:11:44.387013 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-8b75c10b-80dd-4b02-940f-03965d20170b tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: c3ea23ca-a790-4f52-ad85-dcac640a8695] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:11:44.393268 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-8b75c10b-80dd-4b02-940f-03965d20170b tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:44.393712 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-8b75c10b-80dd-4b02-940f-03965d20170b tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:44.394708 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-8b75c10b-80dd-4b02-940f-03965d20170b tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:44.395303 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-8b75c10b-80dd-4b02-940f-03965d20170b tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:44.504240 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-8b75c10b-80dd-4b02-940f-03965d20170b tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "POST /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695/action" status: 200 len: 28723 microversion: 2.20 time: 0.121727 Jan 28 02:11:44.505880 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 410/858] 10.222.0.79 () {62 vars in 1318 bytes} [Fri Jan 28 02:11:44 2022] POST /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695/action => generated 28723 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:11:45.238463 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-051cebab-9b0b-4633-8adc-97631f440919 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:11:45.239074 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-051cebab-9b0b-4633-8adc-97631f440919 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:11:45.252349 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-051cebab-9b0b-4633-8adc-97631f440919 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:45.253575 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-051cebab-9b0b-4633-8adc-97631f440919 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:45.254607 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-051cebab-9b0b-4633-8adc-97631f440919 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:45.255256 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-051cebab-9b0b-4633-8adc-97631f440919 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:45.282142 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-05951e77-7290-4f5f-81a1-df81e2a15c7b tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:11:45.284026 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-05951e77-7290-4f5f-81a1-df81e2a15c7b tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] [instance: 086c6296-168f-46fc-9ec4-8700b7c6ca9f] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:11:45.297951 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-05951e77-7290-4f5f-81a1-df81e2a15c7b tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:45.302004 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-05951e77-7290-4f5f-81a1-df81e2a15c7b tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:45.302004 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-05951e77-7290-4f5f-81a1-df81e2a15c7b tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:45.302004 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-05951e77-7290-4f5f-81a1-df81e2a15c7b tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:45.355221 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-05951e77-7290-4f5f-81a1-df81e2a15c7b tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] 10.222.0.79 "GET /compute/v2.1/servers/086c6296-168f-46fc-9ec4-8700b7c6ca9f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.077628 Jan 28 02:11:45.360809 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 411/859] 10.222.0.79 () {58 vars in 1301 bytes} [Fri Jan 28 02:11:45 2022] GET /compute/v2.1/servers/086c6296-168f-46fc-9ec4-8700b7c6ca9f/os-volume_attachments => generated 25 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 02:11:45.367737 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-2bd2d317-1d15-448f-add8-f20d4f60c51f tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:11:45.368396 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-2bd2d317-1d15-448f-add8-f20d4f60c51f tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] [instance: 086c6296-168f-46fc-9ec4-8700b7c6ca9f] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:11:45.375811 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2bd2d317-1d15-448f-add8-f20d4f60c51f tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:45.377956 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2bd2d317-1d15-448f-add8-f20d4f60c51f tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:45.382284 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2bd2d317-1d15-448f-add8-f20d4f60c51f tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:45.382284 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2bd2d317-1d15-448f-add8-f20d4f60c51f tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:45.484204 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.wsgi [None req-2bd2d317-1d15-448f-add8-f20d4f60c51f tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] HTTP exception thrown: Instance 086c6296-168f-46fc-9ec4-8700b7c6ca9f is not attached to volume e4ea420f-5a33-45f1-a33f-a7f1253addd2 Jan 28 02:11:45.485187 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-2bd2d317-1d15-448f-add8-f20d4f60c51f tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Returning 404 to user: Instance 086c6296-168f-46fc-9ec4-8700b7c6ca9f is not attached to volume e4ea420f-5a33-45f1-a33f-a7f1253addd2 {{(pid=116375) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 02:11:45.486200 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-2bd2d317-1d15-448f-add8-f20d4f60c51f tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] 10.222.0.79 "DELETE /compute/v2.1/servers/086c6296-168f-46fc-9ec4-8700b7c6ca9f/os-volume_attachments/e4ea420f-5a33-45f1-a33f-a7f1253addd2" status: 404 len: 154 microversion: 2.1 time: 0.124251 Jan 28 02:11:45.487259 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 412/860] 10.222.0.79 () {58 vars in 1415 bytes} [Fri Jan 28 02:11:45 2022] DELETE /compute/v2.1/servers/086c6296-168f-46fc-9ec4-8700b7c6ca9f/os-volume_attachments/e4ea420f-5a33-45f1-a33f-a7f1253addd2 => generated 154 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 02:11:45.516670 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-4a574d74-8616-4f8c-af0d-77d0d908e692 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:11:45.518071 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-4a574d74-8616-4f8c-af0d-77d0d908e692 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: c3ea23ca-a790-4f52-ad85-dcac640a8695] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:11:45.531288 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-4a574d74-8616-4f8c-af0d-77d0d908e692 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:45.531733 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-4a574d74-8616-4f8c-af0d-77d0d908e692 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:45.532621 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-4a574d74-8616-4f8c-af0d-77d0d908e692 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:45.533187 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-4a574d74-8616-4f8c-af0d-77d0d908e692 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:45.568369 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-051cebab-9b0b-4633-8adc-97631f440919 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acab2a0c4a0e48909317791a3de85b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abe012ba65845329098e0e06c54b9c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:11:45.576525 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-051cebab-9b0b-4633-8adc-97631f440919 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "GET /compute/v2.1/servers/ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc" status: 200 len: 1363 microversion: 2.1 time: 0.341756 Jan 28 02:11:45.580033 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 449/861] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:11:45 2022] GET /compute/v2.1/servers/ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc => generated 1363 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:11:45.640769 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-4a574d74-8616-4f8c-af0d-77d0d908e692 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "POST /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695/action" status: 200 len: 28723 microversion: 2.20 time: 0.127581 Jan 28 02:11:45.641673 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 413/862] 10.222.0.79 () {62 vars in 1318 bytes} [Fri Jan 28 02:11:45 2022] POST /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695/action => generated 28723 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 28 02:11:46.237847 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-4d89df54-71d5-44aa-bb3c-490b46b495bb tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Action: 'create', calling method: .version_select at 0x7f837d1bf3a0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-710989458"}} {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:11:46.257037 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.quota [None req-4d89df54-71d5-44aa-bb3c-490b46b495bb tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Getting quotas for project 7ed8db325d13496c9a417966e33b10a1. Resources: {'key_pairs'} {{(pid=116374) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 02:11:46.261126 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.quota [None req-4d89df54-71d5-44aa-bb3c-490b46b495bb tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Getting quotas for user 4cdbf7d369e4437eae7a36529d6cd623 and project 7ed8db325d13496c9a417966e33b10a1. Resources: {'key_pairs'} {{(pid=116374) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 02:11:46.595349 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-8afd03ba-0083-4e30-bc1c-7366c8910f43 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:11:46.596368 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-8afd03ba-0083-4e30-bc1c-7366c8910f43 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:11:46.602769 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-8afd03ba-0083-4e30-bc1c-7366c8910f43 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:46.603953 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-8afd03ba-0083-4e30-bc1c-7366c8910f43 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:46.609610 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-8afd03ba-0083-4e30-bc1c-7366c8910f43 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:46.609610 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-8afd03ba-0083-4e30-bc1c-7366c8910f43 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:46.652560 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.quota [None req-4d89df54-71d5-44aa-bb3c-490b46b495bb tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Getting quotas for project 7ed8db325d13496c9a417966e33b10a1. Resources: {'key_pairs'} {{(pid=116374) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 02:11:46.659707 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.quota [None req-4d89df54-71d5-44aa-bb3c-490b46b495bb tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Getting quotas for user 4cdbf7d369e4437eae7a36529d6cd623 and project 7ed8db325d13496c9a417966e33b10a1. Resources: {'key_pairs'} {{(pid=116374) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 02:11:46.681420 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-4d89df54-71d5-44aa-bb3c-490b46b495bb tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 2314 microversion: 2.1 time: 0.638467 Jan 28 02:11:46.682675 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 450/863] 10.222.0.79 () {60 vars in 1157 bytes} [Fri Jan 28 02:11:46 2022] POST /compute/v2.1/os-keypairs => generated 2314 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:11:46.688661 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-d33fa7e4-df2d-4616-888f-5608ad9a0667 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:11:46.689164 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-d33fa7e4-df2d-4616-888f-5608ad9a0667 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: c3ea23ca-a790-4f52-ad85-dcac640a8695] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:11:46.695291 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-d33fa7e4-df2d-4616-888f-5608ad9a0667 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:46.695730 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-d33fa7e4-df2d-4616-888f-5608ad9a0667 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:46.697532 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-d33fa7e4-df2d-4616-888f-5608ad9a0667 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:46.698319 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-d33fa7e4-df2d-4616-888f-5608ad9a0667 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:46.765313 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-8afd03ba-0083-4e30-bc1c-7366c8910f43 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acab2a0c4a0e48909317791a3de85b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abe012ba65845329098e0e06c54b9c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:11:46.772971 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-8afd03ba-0083-4e30-bc1c-7366c8910f43 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "GET /compute/v2.1/servers/ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc" status: 200 len: 1363 microversion: 2.1 time: 0.181831 Jan 28 02:11:46.773567 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 414/864] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:11:46 2022] GET /compute/v2.1/servers/ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc => generated 1363 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:11:46.801379 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-d33fa7e4-df2d-4616-888f-5608ad9a0667 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "POST /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695/action" status: 200 len: 28723 microversion: 2.20 time: 0.116859 Jan 28 02:11:46.802524 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 451/865] 10.222.0.79 () {62 vars in 1318 bytes} [Fri Jan 28 02:11:46 2022] POST /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695/action => generated 28723 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:11:46.822968 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-f1a5c1f1-fb30-4ecc-9a9d-58338402865e tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:11:46.823691 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-f1a5c1f1-fb30-4ecc-9a9d-58338402865e tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] [instance: 086c6296-168f-46fc-9ec4-8700b7c6ca9f] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:11:46.829571 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f1a5c1f1-fb30-4ecc-9a9d-58338402865e tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:46.830287 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f1a5c1f1-fb30-4ecc-9a9d-58338402865e tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:46.831238 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f1a5c1f1-fb30-4ecc-9a9d-58338402865e tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:46.831880 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f1a5c1f1-fb30-4ecc-9a9d-58338402865e tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:46.860353 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-f1a5c1f1-fb30-4ecc-9a9d-58338402865e tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] [instance: 086c6296-168f-46fc-9ec4-8700b7c6ca9f] Going to try to terminate instance {{(pid=116375) delete /opt/stack/nova/nova/compute/api.py:2612}} Jan 28 02:11:47.280191 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-f1a5c1f1-fb30-4ecc-9a9d-58338402865e tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] 10.222.0.79 "DELETE /compute/v2.1/servers/086c6296-168f-46fc-9ec4-8700b7c6ca9f" status: 204 len: 0 microversion: 2.1 time: 0.460996 Jan 28 02:11:47.280737 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 415/866] 10.222.0.79 () {58 vars in 1238 bytes} [Fri Jan 28 02:11:46 2022] DELETE /compute/v2.1/servers/086c6296-168f-46fc-9ec4-8700b7c6ca9f => generated 0 bytes in 463 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 28 02:11:47.289538 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-80bdbdf9-aad0-4d60-b1f3-fa747ca9ac55 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:11:47.290339 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-80bdbdf9-aad0-4d60-b1f3-fa747ca9ac55 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] [instance: 086c6296-168f-46fc-9ec4-8700b7c6ca9f] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:11:47.297153 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-80bdbdf9-aad0-4d60-b1f3-fa747ca9ac55 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:47.297593 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-80bdbdf9-aad0-4d60-b1f3-fa747ca9ac55 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:47.298354 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-80bdbdf9-aad0-4d60-b1f3-fa747ca9ac55 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:47.298782 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-80bdbdf9-aad0-4d60-b1f3-fa747ca9ac55 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:47.450132 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-80bdbdf9-aad0-4d60-b1f3-fa747ca9ac55 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14f6f890deb74eadab6b1ff4b6431036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e991e35dc5b463fbf9f08db0e72cf46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:11:47.457720 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-80bdbdf9-aad0-4d60-b1f3-fa747ca9ac55 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] 10.222.0.79 "GET /compute/v2.1/servers/086c6296-168f-46fc-9ec4-8700b7c6ca9f" status: 200 len: 1553 microversion: 2.1 time: 0.172229 Jan 28 02:11:47.458800 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 452/867] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:11:47 2022] GET /compute/v2.1/servers/086c6296-168f-46fc-9ec4-8700b7c6ca9f => generated 1553 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:11:47.517034 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [req-3d01e06a-1581-4f4a-9aab-1b2c063f6fc7 req-7bd5957f-eba6-4fe3-8646-e74abc9c51ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc", "name": "network-vif-plugged", "status": "completed", "tag": "3247d8ae-933f-49e6-9365-3da79500309f"}]} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:11:47.518619 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:11:47.518619 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: warnings.warn(msg) Jan 28 02:11:47.526831 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-3d01e06a-1581-4f4a-9aab-1b2c063f6fc7 req-7bd5957f-eba6-4fe3-8646-e74abc9c51ad service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:47.527517 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-3d01e06a-1581-4f4a-9aab-1b2c063f6fc7 req-7bd5957f-eba6-4fe3-8646-e74abc9c51ad service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:47.538784 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.compute.server_external_events [req-3d01e06a-1581-4f4a-9aab-1b2c063f6fc7 req-7bd5957f-eba6-4fe3-8646-e74abc9c51ad service nova] Creating event network-vif-plugged:3247d8ae-933f-49e6-9365-3da79500309f for instance ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc on hv-cinder-82497 Jan 28 02:11:47.544204 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [req-3d01e06a-1581-4f4a-9aab-1b2c063f6fc7 req-7bd5957f-eba6-4fe3-8646-e74abc9c51ad service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106053 Jan 28 02:11:47.545096 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 416/868] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Jan 28 02:11:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:11:47.790333 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-35c6d1e2-c0da-44bc-9bcc-fdf93dcffef2 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:11:47.792074 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-35c6d1e2-c0da-44bc-9bcc-fdf93dcffef2 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:11:47.799311 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-35c6d1e2-c0da-44bc-9bcc-fdf93dcffef2 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:47.800422 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-35c6d1e2-c0da-44bc-9bcc-fdf93dcffef2 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:47.804065 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-35c6d1e2-c0da-44bc-9bcc-fdf93dcffef2 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:47.804065 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-35c6d1e2-c0da-44bc-9bcc-fdf93dcffef2 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:47.818596 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-ac1223ba-9bdf-47ea-aadb-9a8928fe00bf tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:11:47.820167 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-ac1223ba-9bdf-47ea-aadb-9a8928fe00bf tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: c3ea23ca-a790-4f52-ad85-dcac640a8695] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:11:47.834148 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ac1223ba-9bdf-47ea-aadb-9a8928fe00bf tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:47.834743 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ac1223ba-9bdf-47ea-aadb-9a8928fe00bf tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:47.835757 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ac1223ba-9bdf-47ea-aadb-9a8928fe00bf tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:47.836296 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ac1223ba-9bdf-47ea-aadb-9a8928fe00bf tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:47.955754 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-ac1223ba-9bdf-47ea-aadb-9a8928fe00bf tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "POST /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695/action" status: 200 len: 29969 microversion: 2.20 time: 0.144516 Jan 28 02:11:47.956571 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 417/869] 10.222.0.79 () {62 vars in 1318 bytes} [Fri Jan 28 02:11:47 2022] POST /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695/action => generated 29969 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 28 02:11:48.023889 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-35c6d1e2-c0da-44bc-9bcc-fdf93dcffef2 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acab2a0c4a0e48909317791a3de85b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abe012ba65845329098e0e06c54b9c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:11:48.035075 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-35c6d1e2-c0da-44bc-9bcc-fdf93dcffef2 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "GET /compute/v2.1/servers/ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc" status: 200 len: 1363 microversion: 2.1 time: 0.245217 Jan 28 02:11:48.045530 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 453/870] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:11:47 2022] GET /compute/v2.1/servers/ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc => generated 1363 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:11:48.477252 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-110b7217-c748-4394-85a4-21c8e98efbc6 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:11:48.477958 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-110b7217-c748-4394-85a4-21c8e98efbc6 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] [instance: 086c6296-168f-46fc-9ec4-8700b7c6ca9f] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:11:48.492302 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-110b7217-c748-4394-85a4-21c8e98efbc6 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:48.492758 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-110b7217-c748-4394-85a4-21c8e98efbc6 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:48.499307 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-110b7217-c748-4394-85a4-21c8e98efbc6 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:48.499307 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-110b7217-c748-4394-85a4-21c8e98efbc6 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:48.772350 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-110b7217-c748-4394-85a4-21c8e98efbc6 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14f6f890deb74eadab6b1ff4b6431036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e991e35dc5b463fbf9f08db0e72cf46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:11:48.795953 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-110b7217-c748-4394-85a4-21c8e98efbc6 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] 10.222.0.79 "GET /compute/v2.1/servers/086c6296-168f-46fc-9ec4-8700b7c6ca9f" status: 200 len: 1553 microversion: 2.1 time: 0.322565 Jan 28 02:11:48.796584 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 418/871] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:11:48 2022] GET /compute/v2.1/servers/086c6296-168f-46fc-9ec4-8700b7c6ca9f => generated 1553 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:11:48.994063 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-7e4324ca-e00f-4f36-bb24-44450b3bf5e6 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:11:48.994063 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-7e4324ca-e00f-4f36-bb24-44450b3bf5e6 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: c3ea23ca-a790-4f52-ad85-dcac640a8695] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:11:48.994063 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-7e4324ca-e00f-4f36-bb24-44450b3bf5e6 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:48.994063 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-7e4324ca-e00f-4f36-bb24-44450b3bf5e6 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:48.995124 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-7e4324ca-e00f-4f36-bb24-44450b3bf5e6 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:48.995124 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-7e4324ca-e00f-4f36-bb24-44450b3bf5e6 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:49.052497 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-8b0585a1-efbd-4aa2-869a-845d981d8488 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:11:49.057317 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-8b0585a1-efbd-4aa2-869a-845d981d8488 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:11:49.062938 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-8b0585a1-efbd-4aa2-869a-845d981d8488 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:49.063406 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-8b0585a1-efbd-4aa2-869a-845d981d8488 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:49.064516 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-8b0585a1-efbd-4aa2-869a-845d981d8488 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:49.065316 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-8b0585a1-efbd-4aa2-869a-845d981d8488 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:49.099670 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-7e4324ca-e00f-4f36-bb24-44450b3bf5e6 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "POST /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695/action" status: 200 len: 31278 microversion: 2.20 time: 0.134754 Jan 28 02:11:49.100819 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 454/872] 10.222.0.79 () {62 vars in 1318 bytes} [Fri Jan 28 02:11:48 2022] POST /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695/action => generated 31278 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:11:49.253370 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-8b0585a1-efbd-4aa2-869a-845d981d8488 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acab2a0c4a0e48909317791a3de85b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abe012ba65845329098e0e06c54b9c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:11:49.263311 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-8b0585a1-efbd-4aa2-869a-845d981d8488 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "GET /compute/v2.1/servers/ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc" status: 200 len: 1363 microversion: 2.1 time: 0.214562 Jan 28 02:11:49.264992 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 419/873] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:11:49 2022] GET /compute/v2.1/servers/ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc => generated 1363 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:11:49.817538 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-0f985cbc-ce46-433b-ae20-74caef14bf73 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:11:49.818286 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-0f985cbc-ce46-433b-ae20-74caef14bf73 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] [instance: 086c6296-168f-46fc-9ec4-8700b7c6ca9f] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:11:49.825934 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-0f985cbc-ce46-433b-ae20-74caef14bf73 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:49.826670 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-0f985cbc-ce46-433b-ae20-74caef14bf73 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:49.827445 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-0f985cbc-ce46-433b-ae20-74caef14bf73 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:49.827899 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-0f985cbc-ce46-433b-ae20-74caef14bf73 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:49.955034 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-0f985cbc-ce46-433b-ae20-74caef14bf73 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14f6f890deb74eadab6b1ff4b6431036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e991e35dc5b463fbf9f08db0e72cf46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:11:49.966737 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-0f985cbc-ce46-433b-ae20-74caef14bf73 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] 10.222.0.79 "GET /compute/v2.1/servers/086c6296-168f-46fc-9ec4-8700b7c6ca9f" status: 200 len: 1553 microversion: 2.1 time: 0.155669 Jan 28 02:11:49.976108 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 455/874] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:11:49 2022] GET /compute/v2.1/servers/086c6296-168f-46fc-9ec4-8700b7c6ca9f => generated 1553 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:11:50.111817 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-e2676a90-53ae-415e-967f-6a0c2190d0b9 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:11:50.113038 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-e2676a90-53ae-415e-967f-6a0c2190d0b9 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: c3ea23ca-a790-4f52-ad85-dcac640a8695] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:11:50.121314 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-e2676a90-53ae-415e-967f-6a0c2190d0b9 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:50.121889 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-e2676a90-53ae-415e-967f-6a0c2190d0b9 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:50.122817 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-e2676a90-53ae-415e-967f-6a0c2190d0b9 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:50.123426 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-e2676a90-53ae-415e-967f-6a0c2190d0b9 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:50.281054 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-8409a536-cc42-491c-8626-52835144c31b tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:11:50.281825 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-8409a536-cc42-491c-8626-52835144c31b tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:11:50.288649 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-8409a536-cc42-491c-8626-52835144c31b tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:50.289226 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-8409a536-cc42-491c-8626-52835144c31b tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:50.290444 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-8409a536-cc42-491c-8626-52835144c31b tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:50.291111 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-8409a536-cc42-491c-8626-52835144c31b tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:50.293930 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-e2676a90-53ae-415e-967f-6a0c2190d0b9 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "POST /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695/action" status: 200 len: 32655 microversion: 2.20 time: 0.185043 Jan 28 02:11:50.294787 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 420/875] 10.222.0.79 () {62 vars in 1318 bytes} [Fri Jan 28 02:11:50 2022] POST /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695/action => generated 32655 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:11:50.489717 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-8409a536-cc42-491c-8626-52835144c31b tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acab2a0c4a0e48909317791a3de85b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abe012ba65845329098e0e06c54b9c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:11:50.498020 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-8409a536-cc42-491c-8626-52835144c31b tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "GET /compute/v2.1/servers/ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc" status: 200 len: 1549 microversion: 2.1 time: 0.220662 Jan 28 02:11:50.498615 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 456/876] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:11:50 2022] GET /compute/v2.1/servers/ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc => generated 1549 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:11:50.515344 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-35f87e25-1310-4c62-8824-032428b0edee tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:11:50.515832 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-35f87e25-1310-4c62-8824-032428b0edee tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:11:50.522491 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-35f87e25-1310-4c62-8824-032428b0edee tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:50.523023 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-35f87e25-1310-4c62-8824-032428b0edee tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:50.523834 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-35f87e25-1310-4c62-8824-032428b0edee tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:50.524299 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-35f87e25-1310-4c62-8824-032428b0edee tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:50.662564 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-35f87e25-1310-4c62-8824-032428b0edee tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "GET /compute/v2.1/servers/ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.151359 Jan 28 02:11:50.663174 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 421/877] 10.222.0.79 () {58 vars in 1274 bytes} [Fri Jan 28 02:11:50 2022] GET /compute/v2.1/servers/ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc/os-interface => generated 285 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:11:50.948271 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [req-b3c5149d-c9eb-4617-a8eb-4ec595176e80 req-4fc65e60-0774-494f-a443-912f2520a48f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "086c6296-168f-46fc-9ec4-8700b7c6ca9f", "name": "network-vif-deleted", "tag": "deb20626-b237-4650-a93b-12a633f6daa5"}]} {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:11:50.949929 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:11:50.949929 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: warnings.warn(msg) Jan 28 02:11:50.958320 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [req-b3c5149d-c9eb-4617-a8eb-4ec595176e80 req-4fc65e60-0774-494f-a443-912f2520a48f service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:50.958769 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [req-b3c5149d-c9eb-4617-a8eb-4ec595176e80 req-4fc65e60-0774-494f-a443-912f2520a48f service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:50.971884 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.compute.server_external_events [req-b3c5149d-c9eb-4617-a8eb-4ec595176e80 req-4fc65e60-0774-494f-a443-912f2520a48f service nova] Creating event network-vif-deleted:deb20626-b237-4650-a93b-12a633f6daa5 for instance 086c6296-168f-46fc-9ec4-8700b7c6ca9f on hv-cinder-82497 Jan 28 02:11:50.976776 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [req-b3c5149d-c9eb-4617-a8eb-4ec595176e80 req-4fc65e60-0774-494f-a443-912f2520a48f service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032906 Jan 28 02:11:50.977672 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 457/878] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Jan 28 02:11:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 02:11:50.984445 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-67484dbc-5888-4a92-8778-fcfb99c9f925 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:11:50.985048 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-67484dbc-5888-4a92-8778-fcfb99c9f925 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] [instance: 086c6296-168f-46fc-9ec4-8700b7c6ca9f] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:11:50.991512 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-67484dbc-5888-4a92-8778-fcfb99c9f925 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:50.991942 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-67484dbc-5888-4a92-8778-fcfb99c9f925 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:50.992952 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-67484dbc-5888-4a92-8778-fcfb99c9f925 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:50.993379 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-67484dbc-5888-4a92-8778-fcfb99c9f925 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:51.072418 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-67484dbc-5888-4a92-8778-fcfb99c9f925 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14f6f890deb74eadab6b1ff4b6431036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e991e35dc5b463fbf9f08db0e72cf46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:11:51.080041 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-67484dbc-5888-4a92-8778-fcfb99c9f925 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] 10.222.0.79 "GET /compute/v2.1/servers/086c6296-168f-46fc-9ec4-8700b7c6ca9f" status: 200 len: 1511 microversion: 2.1 time: 0.099828 Jan 28 02:11:51.080759 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 422/879] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:11:50 2022] GET /compute/v2.1/servers/086c6296-168f-46fc-9ec4-8700b7c6ca9f => generated 1511 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:11:51.307858 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-b955583f-6c3a-428c-b885-a9d0265f7120 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:11:51.308898 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-b955583f-6c3a-428c-b885-a9d0265f7120 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: c3ea23ca-a790-4f52-ad85-dcac640a8695] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:11:51.315172 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-b955583f-6c3a-428c-b885-a9d0265f7120 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:51.315788 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-b955583f-6c3a-428c-b885-a9d0265f7120 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:51.316687 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-b955583f-6c3a-428c-b885-a9d0265f7120 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:51.317117 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-b955583f-6c3a-428c-b885-a9d0265f7120 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:51.448721 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-b955583f-6c3a-428c-b885-a9d0265f7120 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "POST /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695/action" status: 200 len: 33646 microversion: 2.20 time: 0.145725 Jan 28 02:11:51.453263 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 458/880] 10.222.0.79 () {62 vars in 1318 bytes} [Fri Jan 28 02:11:51 2022] POST /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695/action => generated 33646 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:11:51.777346 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-f43e80bd-5b45-49e8-abc2-b278443fa43f tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:11:51.778337 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-f43e80bd-5b45-49e8-abc2-b278443fa43f tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:11:51.785497 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [req-19fe1640-5ffd-4e2c-9b95-b7a26f9be292 req-4d7d88d6-0deb-4f96-aeef-7bc6545cdd32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc", "tag": "3247d8ae-933f-49e6-9365-3da79500309f"}]} {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:11:51.787190 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:11:51.787190 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: warnings.warn(msg) Jan 28 02:11:51.797458 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [req-19fe1640-5ffd-4e2c-9b95-b7a26f9be292 req-4d7d88d6-0deb-4f96-aeef-7bc6545cdd32 service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:51.797904 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [req-19fe1640-5ffd-4e2c-9b95-b7a26f9be292 req-4d7d88d6-0deb-4f96-aeef-7bc6545cdd32 service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:51.804804 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f43e80bd-5b45-49e8-abc2-b278443fa43f tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:51.805251 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f43e80bd-5b45-49e8-abc2-b278443fa43f tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:51.806471 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f43e80bd-5b45-49e8-abc2-b278443fa43f tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:51.806966 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f43e80bd-5b45-49e8-abc2-b278443fa43f tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:51.819781 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.compute.server_external_events [req-19fe1640-5ffd-4e2c-9b95-b7a26f9be292 req-4d7d88d6-0deb-4f96-aeef-7bc6545cdd32 service nova] Creating event network-changed:3247d8ae-933f-49e6-9365-3da79500309f for instance ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc on hv-cinder-82497 Jan 28 02:11:51.825361 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [req-19fe1640-5ffd-4e2c-9b95-b7a26f9be292 req-4d7d88d6-0deb-4f96-aeef-7bc6545cdd32 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043877 Jan 28 02:11:51.826165 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 459/881] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Jan 28 02:11:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:11:52.031129 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-f43e80bd-5b45-49e8-abc2-b278443fa43f tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "POST /compute/v2.1/servers/ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc/action" status: 200 len: 14 microversion: 2.1 time: 0.257752 Jan 28 02:11:52.035357 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 423/882] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Jan 28 02:11:51 2022] POST /compute/v2.1/servers/ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc/action => generated 14 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 02:11:52.099046 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-9430b36c-68c2-4799-a9fc-29a7551f1962 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:11:52.100216 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-9430b36c-68c2-4799-a9fc-29a7551f1962 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] [instance: 086c6296-168f-46fc-9ec4-8700b7c6ca9f] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:11:52.106868 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-9430b36c-68c2-4799-a9fc-29a7551f1962 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:52.107307 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-9430b36c-68c2-4799-a9fc-29a7551f1962 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:52.108539 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-9430b36c-68c2-4799-a9fc-29a7551f1962 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:52.109137 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-9430b36c-68c2-4799-a9fc-29a7551f1962 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:52.151309 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-9430b36c-68c2-4799-a9fc-29a7551f1962 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:52.151888 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-9430b36c-68c2-4799-a9fc-29a7551f1962 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:52.153049 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.objects.instance [None req-9430b36c-68c2-4799-a9fc-29a7551f1962 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lazy-loading 'fault' on Instance uuid 086c6296-168f-46fc-9ec4-8700b7c6ca9f {{(pid=116374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jan 28 02:11:52.219947 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-9430b36c-68c2-4799-a9fc-29a7551f1962 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14f6f890deb74eadab6b1ff4b6431036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e991e35dc5b463fbf9f08db0e72cf46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:11:52.227592 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-9430b36c-68c2-4799-a9fc-29a7551f1962 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] 10.222.0.79 "GET /compute/v2.1/servers/086c6296-168f-46fc-9ec4-8700b7c6ca9f" status: 200 len: 1348 microversion: 2.1 time: 0.133768 Jan 28 02:11:52.238420 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 460/883] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:11:52 2022] GET /compute/v2.1/servers/086c6296-168f-46fc-9ec4-8700b7c6ca9f => generated 1348 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:11:52.461690 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-b6f84ff2-c3a6-4850-bb38-0374756f7b65 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:11:52.463494 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-b6f84ff2-c3a6-4850-bb38-0374756f7b65 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: c3ea23ca-a790-4f52-ad85-dcac640a8695] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:11:52.470189 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b6f84ff2-c3a6-4850-bb38-0374756f7b65 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:52.471184 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b6f84ff2-c3a6-4850-bb38-0374756f7b65 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:52.472191 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b6f84ff2-c3a6-4850-bb38-0374756f7b65 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:52.472800 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b6f84ff2-c3a6-4850-bb38-0374756f7b65 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:52.637459 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-b6f84ff2-c3a6-4850-bb38-0374756f7b65 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "POST /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695/action" status: 200 len: 34167 microversion: 2.20 time: 0.179713 Jan 28 02:11:52.638826 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 424/884] 10.222.0.79 () {62 vars in 1318 bytes} [Fri Jan 28 02:11:52 2022] POST /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695/action => generated 34167 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 28 02:11:53.042845 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-fc969085-9828-416e-938c-1667e54332ad tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:11:53.043864 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-fc969085-9828-416e-938c-1667e54332ad tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:11:53.050808 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-fc969085-9828-416e-938c-1667e54332ad tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:53.051256 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-fc969085-9828-416e-938c-1667e54332ad tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:53.052307 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-fc969085-9828-416e-938c-1667e54332ad tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:53.052776 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-fc969085-9828-416e-938c-1667e54332ad tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:53.210277 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-fc969085-9828-416e-938c-1667e54332ad tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "POST /compute/v2.1/servers/ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc/action" status: 200 len: 14 microversion: 2.1 time: 0.171023 Jan 28 02:11:53.211576 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 461/885] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Jan 28 02:11:53 2022] POST /compute/v2.1/servers/ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc/action => generated 14 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 02:11:53.247531 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-47d1fd92-846f-495b-bd78-60f180c50af5 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:11:53.248341 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-47d1fd92-846f-495b-bd78-60f180c50af5 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] [instance: 086c6296-168f-46fc-9ec4-8700b7c6ca9f] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:11:53.255176 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-47d1fd92-846f-495b-bd78-60f180c50af5 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:53.255626 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-47d1fd92-846f-495b-bd78-60f180c50af5 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:53.256436 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-47d1fd92-846f-495b-bd78-60f180c50af5 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:53.256866 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-47d1fd92-846f-495b-bd78-60f180c50af5 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:53.271606 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.wsgi [None req-47d1fd92-846f-495b-bd78-60f180c50af5 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] HTTP exception thrown: Instance 086c6296-168f-46fc-9ec4-8700b7c6ca9f could not be found. Jan 28 02:11:53.272240 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-47d1fd92-846f-495b-bd78-60f180c50af5 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Returning 404 to user: Instance 086c6296-168f-46fc-9ec4-8700b7c6ca9f could not be found. {{(pid=116375) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 02:11:53.276272 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-47d1fd92-846f-495b-bd78-60f180c50af5 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] 10.222.0.79 "GET /compute/v2.1/servers/086c6296-168f-46fc-9ec4-8700b7c6ca9f" status: 404 len: 111 microversion: 2.1 time: 0.031428 Jan 28 02:11:53.276272 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 425/886] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:11:53 2022] GET /compute/v2.1/servers/086c6296-168f-46fc-9ec4-8700b7c6ca9f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 02:11:53.284390 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-ed7d089f-f089-4fa7-8a51-7298b58d56e9 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] Calling method '.version_select at 0x7f837c400160>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:11:53.394817 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-ed7d089f-f089-4fa7-8a51-7298b58d56e9 tempest-TestMinimumBasicScenario-990053527 tempest-TestMinimumBasicScenario-990053527-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-845287693" status: 202 len: 0 microversion: 2.1 time: 0.115129 Jan 28 02:11:53.395787 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 462/887] 10.222.0.79 () {58 vars in 1268 bytes} [Fri Jan 28 02:11:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-845287693 => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:11:53.651232 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-92b2b176-7d93-46b1-b8bf-f942cdce7e71 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:11:53.652182 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-92b2b176-7d93-46b1-b8bf-f942cdce7e71 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: c3ea23ca-a790-4f52-ad85-dcac640a8695] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:11:53.658089 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-92b2b176-7d93-46b1-b8bf-f942cdce7e71 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:53.658555 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-92b2b176-7d93-46b1-b8bf-f942cdce7e71 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:53.659324 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-92b2b176-7d93-46b1-b8bf-f942cdce7e71 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:53.659751 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-92b2b176-7d93-46b1-b8bf-f942cdce7e71 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:53.769109 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-92b2b176-7d93-46b1-b8bf-f942cdce7e71 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "POST /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695/action" status: 200 len: 35012 microversion: 2.20 time: 0.122475 Jan 28 02:11:53.773196 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 426/888] 10.222.0.79 () {62 vars in 1318 bytes} [Fri Jan 28 02:11:53 2022] POST /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695/action => generated 35012 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:11:54.221825 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-4a0570db-6939-4e24-aa69-0d3b3cd8e3ee tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:11:54.222876 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-4a0570db-6939-4e24-aa69-0d3b3cd8e3ee tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:11:54.230821 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-4a0570db-6939-4e24-aa69-0d3b3cd8e3ee tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:54.231366 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-4a0570db-6939-4e24-aa69-0d3b3cd8e3ee tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:54.232220 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-4a0570db-6939-4e24-aa69-0d3b3cd8e3ee tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:54.232839 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-4a0570db-6939-4e24-aa69-0d3b3cd8e3ee tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:54.336260 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-4a0570db-6939-4e24-aa69-0d3b3cd8e3ee tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "POST /compute/v2.1/servers/ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc/action" status: 200 len: 14 microversion: 2.1 time: 0.118211 Jan 28 02:11:54.336894 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 463/889] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Jan 28 02:11:54 2022] POST /compute/v2.1/servers/ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc/action => generated 14 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 02:11:54.782418 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-0a9aa1bc-94fb-4aef-82e8-091eac471517 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:11:54.783487 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-0a9aa1bc-94fb-4aef-82e8-091eac471517 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: c3ea23ca-a790-4f52-ad85-dcac640a8695] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:11:54.789838 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-0a9aa1bc-94fb-4aef-82e8-091eac471517 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:54.790311 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-0a9aa1bc-94fb-4aef-82e8-091eac471517 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:54.791091 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-0a9aa1bc-94fb-4aef-82e8-091eac471517 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:54.791520 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-0a9aa1bc-94fb-4aef-82e8-091eac471517 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:54.897513 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-0a9aa1bc-94fb-4aef-82e8-091eac471517 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "POST /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695/action" status: 200 len: 35840 microversion: 2.20 time: 0.119631 Jan 28 02:11:54.898165 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 427/890] 10.222.0.79 () {62 vars in 1318 bytes} [Fri Jan 28 02:11:54 2022] POST /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695/action => generated 35840 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 28 02:11:55.348037 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-920c4632-1dd5-47d1-bc04-db3cf3046ecb tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:11:55.348942 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-920c4632-1dd5-47d1-bc04-db3cf3046ecb tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:11:55.356043 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-920c4632-1dd5-47d1-bc04-db3cf3046ecb tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:55.356489 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-920c4632-1dd5-47d1-bc04-db3cf3046ecb tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:55.357408 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-920c4632-1dd5-47d1-bc04-db3cf3046ecb tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:55.358044 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-920c4632-1dd5-47d1-bc04-db3cf3046ecb tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:55.457831 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-920c4632-1dd5-47d1-bc04-db3cf3046ecb tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "POST /compute/v2.1/servers/ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc/action" status: 200 len: 14 microversion: 2.1 time: 0.113827 Jan 28 02:11:55.458610 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 464/891] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Jan 28 02:11:55 2022] POST /compute/v2.1/servers/ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc/action => generated 14 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 02:11:55.909367 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-369375c0-dbb9-4b91-bdf4-0f693d3c3f78 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:11:55.910608 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-369375c0-dbb9-4b91-bdf4-0f693d3c3f78 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: c3ea23ca-a790-4f52-ad85-dcac640a8695] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:11:55.917431 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-369375c0-dbb9-4b91-bdf4-0f693d3c3f78 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:55.917871 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-369375c0-dbb9-4b91-bdf4-0f693d3c3f78 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:55.918631 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-369375c0-dbb9-4b91-bdf4-0f693d3c3f78 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:55.919059 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-369375c0-dbb9-4b91-bdf4-0f693d3c3f78 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:56.030475 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-369375c0-dbb9-4b91-bdf4-0f693d3c3f78 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "POST /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695/action" status: 200 len: 36918 microversion: 2.20 time: 0.125106 Jan 28 02:11:56.032217 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 428/892] 10.222.0.79 () {62 vars in 1318 bytes} [Fri Jan 28 02:11:55 2022] POST /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695/action => generated 36918 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:11:56.471280 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-7229ecbf-7df0-49a1-b895-21747c3b05bc tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:11:56.472678 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-7229ecbf-7df0-49a1-b895-21747c3b05bc tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:11:56.482833 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-7229ecbf-7df0-49a1-b895-21747c3b05bc tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:56.483510 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-7229ecbf-7df0-49a1-b895-21747c3b05bc tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:56.484392 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-7229ecbf-7df0-49a1-b895-21747c3b05bc tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:56.484830 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-7229ecbf-7df0-49a1-b895-21747c3b05bc tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:56.591676 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-7229ecbf-7df0-49a1-b895-21747c3b05bc tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "POST /compute/v2.1/servers/ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc/action" status: 200 len: 14 microversion: 2.1 time: 0.126224 Jan 28 02:11:56.592374 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 465/893] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Jan 28 02:11:56 2022] POST /compute/v2.1/servers/ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc/action => generated 14 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 28 02:11:57.046525 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-c2af56ec-1fa8-42d1-b703-1c2d4044d020 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:11:57.046525 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-c2af56ec-1fa8-42d1-b703-1c2d4044d020 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: c3ea23ca-a790-4f52-ad85-dcac640a8695] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:11:57.053313 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c2af56ec-1fa8-42d1-b703-1c2d4044d020 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:57.053937 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c2af56ec-1fa8-42d1-b703-1c2d4044d020 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:57.055034 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c2af56ec-1fa8-42d1-b703-1c2d4044d020 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:57.055628 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c2af56ec-1fa8-42d1-b703-1c2d4044d020 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:57.165695 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-c2af56ec-1fa8-42d1-b703-1c2d4044d020 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "POST /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695/action" status: 200 len: 38063 microversion: 2.20 time: 0.126145 Jan 28 02:11:57.170549 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 429/894] 10.222.0.79 () {62 vars in 1318 bytes} [Fri Jan 28 02:11:57 2022] POST /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695/action => generated 38063 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:11:57.603817 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-d68fa5bf-6b8b-46ad-b262-9ef16581bd70 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:11:57.604852 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-d68fa5bf-6b8b-46ad-b262-9ef16581bd70 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:11:57.612599 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-d68fa5bf-6b8b-46ad-b262-9ef16581bd70 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:57.613043 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-d68fa5bf-6b8b-46ad-b262-9ef16581bd70 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:57.613817 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-d68fa5bf-6b8b-46ad-b262-9ef16581bd70 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:57.614247 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-d68fa5bf-6b8b-46ad-b262-9ef16581bd70 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:57.718008 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-d68fa5bf-6b8b-46ad-b262-9ef16581bd70 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "POST /compute/v2.1/servers/ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc/action" status: 200 len: 14 microversion: 2.1 time: 0.119142 Jan 28 02:11:57.721490 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 466/895] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Jan 28 02:11:57 2022] POST /compute/v2.1/servers/ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc/action => generated 14 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 02:11:58.179606 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-78849ce1-af74-421a-a83c-7bd8182abd1a tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:11:58.180642 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-78849ce1-af74-421a-a83c-7bd8182abd1a tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: c3ea23ca-a790-4f52-ad85-dcac640a8695] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:11:58.190838 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-78849ce1-af74-421a-a83c-7bd8182abd1a tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:58.191284 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-78849ce1-af74-421a-a83c-7bd8182abd1a tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:58.192400 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-78849ce1-af74-421a-a83c-7bd8182abd1a tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:58.192837 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-78849ce1-af74-421a-a83c-7bd8182abd1a tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:58.319372 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-78849ce1-af74-421a-a83c-7bd8182abd1a tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "POST /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695/action" status: 200 len: 38277 microversion: 2.20 time: 0.144072 Jan 28 02:11:58.320402 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 430/896] 10.222.0.79 () {62 vars in 1318 bytes} [Fri Jan 28 02:11:58 2022] POST /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695/action => generated 38277 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 28 02:11:58.729818 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-30369093-7192-4672-869f-7411d7bbf4ba tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:11:58.730886 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-30369093-7192-4672-869f-7411d7bbf4ba tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:11:58.737586 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-30369093-7192-4672-869f-7411d7bbf4ba tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:58.738355 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-30369093-7192-4672-869f-7411d7bbf4ba tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:58.739190 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-30369093-7192-4672-869f-7411d7bbf4ba tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:58.739680 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-30369093-7192-4672-869f-7411d7bbf4ba tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:58.843673 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-30369093-7192-4672-869f-7411d7bbf4ba tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "POST /compute/v2.1/servers/ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc/action" status: 200 len: 14 microversion: 2.1 time: 0.114745 Jan 28 02:11:58.844684 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 467/897] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Jan 28 02:11:58 2022] POST /compute/v2.1/servers/ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc/action => generated 14 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 02:11:59.332614 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-641c19a3-8c5d-46bb-90dc-b02b8afc31b6 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:11:59.334931 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-641c19a3-8c5d-46bb-90dc-b02b8afc31b6 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: c3ea23ca-a790-4f52-ad85-dcac640a8695] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:11:59.342195 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-641c19a3-8c5d-46bb-90dc-b02b8afc31b6 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:59.342638 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-641c19a3-8c5d-46bb-90dc-b02b8afc31b6 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:59.343422 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-641c19a3-8c5d-46bb-90dc-b02b8afc31b6 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:59.343855 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-641c19a3-8c5d-46bb-90dc-b02b8afc31b6 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:59.452106 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-641c19a3-8c5d-46bb-90dc-b02b8afc31b6 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "POST /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695/action" status: 200 len: 38277 microversion: 2.20 time: 0.123494 Jan 28 02:11:59.456750 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 431/898] 10.222.0.79 () {62 vars in 1318 bytes} [Fri Jan 28 02:11:59 2022] POST /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695/action => generated 38277 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:11:59.856519 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-4efcd7c5-6e36-40c6-bb58-10db25a0a25b tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:11:59.857574 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-4efcd7c5-6e36-40c6-bb58-10db25a0a25b tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:11:59.864427 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-4efcd7c5-6e36-40c6-bb58-10db25a0a25b tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:59.865294 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-4efcd7c5-6e36-40c6-bb58-10db25a0a25b tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:59.866328 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-4efcd7c5-6e36-40c6-bb58-10db25a0a25b tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:11:59.866990 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-4efcd7c5-6e36-40c6-bb58-10db25a0a25b tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:11:59.959563 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-4efcd7c5-6e36-40c6-bb58-10db25a0a25b tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "POST /compute/v2.1/servers/ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc/action" status: 200 len: 14 microversion: 2.1 time: 0.107606 Jan 28 02:11:59.963139 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 468/899] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Jan 28 02:11:59 2022] POST /compute/v2.1/servers/ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc/action => generated 14 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 02:12:00.466617 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-b1a3539c-afd8-4414-ab02-e1730a9e71fe tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:12:00.467826 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-b1a3539c-afd8-4414-ab02-e1730a9e71fe tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: c3ea23ca-a790-4f52-ad85-dcac640a8695] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:00.474617 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b1a3539c-afd8-4414-ab02-e1730a9e71fe tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:00.475247 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b1a3539c-afd8-4414-ab02-e1730a9e71fe tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:00.476140 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b1a3539c-afd8-4414-ab02-e1730a9e71fe tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:00.476646 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b1a3539c-afd8-4414-ab02-e1730a9e71fe tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:00.586963 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-b1a3539c-afd8-4414-ab02-e1730a9e71fe tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "POST /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695/action" status: 200 len: 38420 microversion: 2.20 time: 0.125314 Jan 28 02:12:00.588010 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 432/900] 10.222.0.79 () {62 vars in 1318 bytes} [Fri Jan 28 02:12:00 2022] POST /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695/action => generated 38420 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:12:00.599640 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-91020efb-2e39-48f0-a744-b0b0d8855285 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:12:00.600716 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-91020efb-2e39-48f0-a744-b0b0d8855285 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: c3ea23ca-a790-4f52-ad85-dcac640a8695] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:00.608765 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-91020efb-2e39-48f0-a744-b0b0d8855285 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:00.609531 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-91020efb-2e39-48f0-a744-b0b0d8855285 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:00.610569 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-91020efb-2e39-48f0-a744-b0b0d8855285 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:00.611041 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-91020efb-2e39-48f0-a744-b0b0d8855285 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:00.637675 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-91020efb-2e39-48f0-a744-b0b0d8855285 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695/ips" status: 200 len: 150 microversion: 2.20 time: 0.042737 Jan 28 02:12:00.638257 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 469/901] 10.222.0.79 () {60 vars in 1288 bytes} [Fri Jan 28 02:12:00 2022] GET /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695/ips => generated 150 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 02:12:00.975004 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-89f4c5d8-2dfc-421a-8d17-5d843af5e168 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:12:00.976014 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-89f4c5d8-2dfc-421a-8d17-5d843af5e168 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:00.987111 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-89f4c5d8-2dfc-421a-8d17-5d843af5e168 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:00.987848 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-89f4c5d8-2dfc-421a-8d17-5d843af5e168 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:00.988854 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-89f4c5d8-2dfc-421a-8d17-5d843af5e168 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:00.989440 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-89f4c5d8-2dfc-421a-8d17-5d843af5e168 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:01.097970 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-89f4c5d8-2dfc-421a-8d17-5d843af5e168 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "POST /compute/v2.1/servers/ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc/action" status: 200 len: 14 microversion: 2.1 time: 0.130046 Jan 28 02:12:01.099802 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 433/902] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Jan 28 02:12:00 2022] POST /compute/v2.1/servers/ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc/action => generated 14 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 02:12:02.109871 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-0c3ea3f3-52d6-4787-835f-1ea5510717f6 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:12:02.110889 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-0c3ea3f3-52d6-4787-835f-1ea5510717f6 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:02.117571 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-0c3ea3f3-52d6-4787-835f-1ea5510717f6 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:02.119188 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-0c3ea3f3-52d6-4787-835f-1ea5510717f6 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:02.119320 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-0c3ea3f3-52d6-4787-835f-1ea5510717f6 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:02.119720 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-0c3ea3f3-52d6-4787-835f-1ea5510717f6 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:02.227358 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-0c3ea3f3-52d6-4787-835f-1ea5510717f6 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "POST /compute/v2.1/servers/ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc/action" status: 200 len: 14 microversion: 2.1 time: 0.120673 Jan 28 02:12:02.228614 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 470/903] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Jan 28 02:12:02 2022] POST /compute/v2.1/servers/ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc/action => generated 14 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 02:12:03.238506 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-541b4ea1-30d8-4748-a74f-1a85a0c2ed7e tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:12:03.239493 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-541b4ea1-30d8-4748-a74f-1a85a0c2ed7e tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:03.246139 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-541b4ea1-30d8-4748-a74f-1a85a0c2ed7e tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:03.246582 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-541b4ea1-30d8-4748-a74f-1a85a0c2ed7e tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:03.247365 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-541b4ea1-30d8-4748-a74f-1a85a0c2ed7e tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:03.247787 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-541b4ea1-30d8-4748-a74f-1a85a0c2ed7e tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:03.354391 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-541b4ea1-30d8-4748-a74f-1a85a0c2ed7e tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "POST /compute/v2.1/servers/ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc/action" status: 200 len: 14 microversion: 2.1 time: 0.119652 Jan 28 02:12:03.355040 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 434/904] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Jan 28 02:12:03 2022] POST /compute/v2.1/servers/ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc/action => generated 14 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 02:12:03.362621 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-6e87a449-242f-4c26-a6df-71fbe835e438 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:12:03.363268 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-6e87a449-242f-4c26-a6df-71fbe835e438 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: c3ea23ca-a790-4f52-ad85-dcac640a8695] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:03.372177 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-6e87a449-242f-4c26-a6df-71fbe835e438 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:03.372177 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-6e87a449-242f-4c26-a6df-71fbe835e438 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:03.372177 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-6e87a449-242f-4c26-a6df-71fbe835e438 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:03.372177 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-6e87a449-242f-4c26-a6df-71fbe835e438 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:03.396831 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.objects.instance [None req-6e87a449-242f-4c26-a6df-71fbe835e438 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lazy-loading 'flavor' on Instance uuid c3ea23ca-a790-4f52-ad85-dcac640a8695 {{(pid=116374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jan 28 02:12:03.923262 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-6e87a449-242f-4c26-a6df-71fbe835e438 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "POST /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695/action" status: 202 len: 0 microversion: 2.20 time: 0.564929 Jan 28 02:12:03.923884 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 471/905] 10.222.0.79 () {62 vars in 1318 bytes} [Fri Jan 28 02:12:03 2022] POST /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695/action => generated 0 bytes in 567 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 28 02:12:03.932608 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-09dfb94f-4a73-4b48-bd61-3f5389989ef5 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:12:03.938727 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-09dfb94f-4a73-4b48-bd61-3f5389989ef5 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: c3ea23ca-a790-4f52-ad85-dcac640a8695] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:03.940431 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-09dfb94f-4a73-4b48-bd61-3f5389989ef5 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:03.940880 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-09dfb94f-4a73-4b48-bd61-3f5389989ef5 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:03.941655 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-09dfb94f-4a73-4b48-bd61-3f5389989ef5 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:03.942084 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-09dfb94f-4a73-4b48-bd61-3f5389989ef5 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:04.088127 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-09dfb94f-4a73-4b48-bd61-3f5389989ef5 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:04.096271 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-09dfb94f-4a73-4b48-bd61-3f5389989ef5 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:04.097736 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-09dfb94f-4a73-4b48-bd61-3f5389989ef5 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:04.098863 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-09dfb94f-4a73-4b48-bd61-3f5389989ef5 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695" status: 200 len: 1721 microversion: 2.20 time: 0.170599 Jan 28 02:12:04.099412 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 435/906] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:12:03 2022] GET /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695 => generated 1721 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:12:04.365872 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-e2ddc622-8ecc-4180-8311-9bfd00d8f0dc tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:12:04.366858 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-e2ddc622-8ecc-4180-8311-9bfd00d8f0dc tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:04.374371 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-e2ddc622-8ecc-4180-8311-9bfd00d8f0dc tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:04.378261 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-e2ddc622-8ecc-4180-8311-9bfd00d8f0dc tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:04.378261 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-e2ddc622-8ecc-4180-8311-9bfd00d8f0dc tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:04.378261 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-e2ddc622-8ecc-4180-8311-9bfd00d8f0dc tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:04.481416 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-e2ddc622-8ecc-4180-8311-9bfd00d8f0dc tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "POST /compute/v2.1/servers/ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc/action" status: 200 len: 377 microversion: 2.1 time: 0.119497 Jan 28 02:12:04.484457 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 472/907] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Jan 28 02:12:04 2022] POST /compute/v2.1/servers/ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc/action => generated 377 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:12:05.117176 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-8e6d3ced-d649-4eb2-9105-efc11a89b58b tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:12:05.117754 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-8e6d3ced-d649-4eb2-9105-efc11a89b58b tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: c3ea23ca-a790-4f52-ad85-dcac640a8695] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:05.125102 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-8e6d3ced-d649-4eb2-9105-efc11a89b58b tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:05.128230 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-8e6d3ced-d649-4eb2-9105-efc11a89b58b tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:05.128230 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-8e6d3ced-d649-4eb2-9105-efc11a89b58b tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:05.128230 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-8e6d3ced-d649-4eb2-9105-efc11a89b58b tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:05.247916 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-8e6d3ced-d649-4eb2-9105-efc11a89b58b tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:05.255547 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-8e6d3ced-d649-4eb2-9105-efc11a89b58b tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:05.257048 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-8e6d3ced-d649-4eb2-9105-efc11a89b58b tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:05.258259 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-8e6d3ced-d649-4eb2-9105-efc11a89b58b tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695" status: 200 len: 1721 microversion: 2.20 time: 0.144951 Jan 28 02:12:05.259480 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 436/908] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:12:05 2022] GET /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695 => generated 1721 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:12:05.492935 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-a4fe1eb8-842e-42ff-82ac-51107d56319c tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:12:05.494505 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-a4fe1eb8-842e-42ff-82ac-51107d56319c tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:05.500905 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-a4fe1eb8-842e-42ff-82ac-51107d56319c tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:05.501352 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-a4fe1eb8-842e-42ff-82ac-51107d56319c tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:05.502120 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-a4fe1eb8-842e-42ff-82ac-51107d56319c tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:05.502552 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-a4fe1eb8-842e-42ff-82ac-51107d56319c tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:05.612633 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-a4fe1eb8-842e-42ff-82ac-51107d56319c tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "POST /compute/v2.1/servers/ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc/action" status: 200 len: 10415 microversion: 2.1 time: 0.123652 Jan 28 02:12:05.613267 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 473/909] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Jan 28 02:12:05 2022] POST /compute/v2.1/servers/ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc/action => generated 10415 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 02:12:06.277459 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-fcaf9f01-b486-41f5-a1f9-c99035db7738 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:12:06.278049 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-fcaf9f01-b486-41f5-a1f9-c99035db7738 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: c3ea23ca-a790-4f52-ad85-dcac640a8695] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:06.284216 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-fcaf9f01-b486-41f5-a1f9-c99035db7738 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:06.284656 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-fcaf9f01-b486-41f5-a1f9-c99035db7738 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:06.285406 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-fcaf9f01-b486-41f5-a1f9-c99035db7738 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:06.285831 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-fcaf9f01-b486-41f5-a1f9-c99035db7738 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:06.403231 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-fcaf9f01-b486-41f5-a1f9-c99035db7738 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:06.410806 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-fcaf9f01-b486-41f5-a1f9-c99035db7738 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:06.412303 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-fcaf9f01-b486-41f5-a1f9-c99035db7738 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:06.413433 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-fcaf9f01-b486-41f5-a1f9-c99035db7738 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695" status: 200 len: 1721 microversion: 2.20 time: 0.139875 Jan 28 02:12:06.413984 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 437/910] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:12:06 2022] GET /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695 => generated 1721 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:12:06.625174 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-b972767a-a9e5-446b-97ef-919c33e54069 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:12:06.626213 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-b972767a-a9e5-446b-97ef-919c33e54069 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:06.632779 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-b972767a-a9e5-446b-97ef-919c33e54069 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:06.633215 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-b972767a-a9e5-446b-97ef-919c33e54069 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:06.634222 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-b972767a-a9e5-446b-97ef-919c33e54069 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:06.634730 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-b972767a-a9e5-446b-97ef-919c33e54069 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:06.737876 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-b972767a-a9e5-446b-97ef-919c33e54069 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "POST /compute/v2.1/servers/ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc/action" status: 200 len: 16235 microversion: 2.1 time: 0.116597 Jan 28 02:12:06.737876 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 474/911] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Jan 28 02:12:06 2022] POST /compute/v2.1/servers/ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc/action => generated 16235 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 02:12:07.432848 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-c0de9350-c5d1-477b-96b9-61bb96a7c6f4 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:12:07.433456 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-c0de9350-c5d1-477b-96b9-61bb96a7c6f4 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: c3ea23ca-a790-4f52-ad85-dcac640a8695] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:07.439724 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c0de9350-c5d1-477b-96b9-61bb96a7c6f4 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:07.440207 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c0de9350-c5d1-477b-96b9-61bb96a7c6f4 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:07.440976 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c0de9350-c5d1-477b-96b9-61bb96a7c6f4 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:07.441407 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c0de9350-c5d1-477b-96b9-61bb96a7c6f4 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:07.564567 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-c0de9350-c5d1-477b-96b9-61bb96a7c6f4 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:07.572962 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-c0de9350-c5d1-477b-96b9-61bb96a7c6f4 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:07.575742 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-c0de9350-c5d1-477b-96b9-61bb96a7c6f4 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:07.575742 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-c0de9350-c5d1-477b-96b9-61bb96a7c6f4 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695" status: 200 len: 1721 microversion: 2.20 time: 0.147209 Jan 28 02:12:07.576259 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 438/912] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:12:07 2022] GET /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695 => generated 1721 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:12:07.749061 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-cfa215ec-0f4c-4dd9-a5c0-93d01a1280cb tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:12:07.749970 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-cfa215ec-0f4c-4dd9-a5c0-93d01a1280cb tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:07.756492 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-cfa215ec-0f4c-4dd9-a5c0-93d01a1280cb tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:07.756930 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-cfa215ec-0f4c-4dd9-a5c0-93d01a1280cb tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:07.757692 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-cfa215ec-0f4c-4dd9-a5c0-93d01a1280cb tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:07.758121 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-cfa215ec-0f4c-4dd9-a5c0-93d01a1280cb tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:07.870863 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-cfa215ec-0f4c-4dd9-a5c0-93d01a1280cb tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "POST /compute/v2.1/servers/ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc/action" status: 200 len: 17960 microversion: 2.1 time: 0.125723 Jan 28 02:12:07.871512 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 475/913] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Jan 28 02:12:07 2022] POST /compute/v2.1/servers/ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc/action => generated 17960 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 02:12:08.594144 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-c45882e1-abfd-44a4-8006-16fe7a7f765a tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:12:08.594737 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-c45882e1-abfd-44a4-8006-16fe7a7f765a tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: c3ea23ca-a790-4f52-ad85-dcac640a8695] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:08.600911 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c45882e1-abfd-44a4-8006-16fe7a7f765a tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:08.601356 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c45882e1-abfd-44a4-8006-16fe7a7f765a tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:08.602116 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c45882e1-abfd-44a4-8006-16fe7a7f765a tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:08.602549 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c45882e1-abfd-44a4-8006-16fe7a7f765a tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:08.722103 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-c45882e1-abfd-44a4-8006-16fe7a7f765a tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:08.730799 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-c45882e1-abfd-44a4-8006-16fe7a7f765a tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:08.732316 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-c45882e1-abfd-44a4-8006-16fe7a7f765a tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:08.733505 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-c45882e1-abfd-44a4-8006-16fe7a7f765a tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695" status: 200 len: 1721 microversion: 2.20 time: 0.143224 Jan 28 02:12:08.734064 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 439/914] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:12:08 2022] GET /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695 => generated 1721 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:12:08.882190 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-ce938fb1-bd28-446f-88f1-45f7fcda7ea2 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:12:08.883302 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-ce938fb1-bd28-446f-88f1-45f7fcda7ea2 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:08.890387 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-ce938fb1-bd28-446f-88f1-45f7fcda7ea2 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:08.890841 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-ce938fb1-bd28-446f-88f1-45f7fcda7ea2 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:08.891626 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-ce938fb1-bd28-446f-88f1-45f7fcda7ea2 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:08.892163 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-ce938fb1-bd28-446f-88f1-45f7fcda7ea2 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:08.998262 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-ce938fb1-bd28-446f-88f1-45f7fcda7ea2 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "POST /compute/v2.1/servers/ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc/action" status: 200 len: 19446 microversion: 2.1 time: 0.120223 Jan 28 02:12:08.999140 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 476/915] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Jan 28 02:12:08 2022] POST /compute/v2.1/servers/ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc/action => generated 19446 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 02:12:09.020430 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-28190264-c4f6-4d09-a1f9-f8920de6d901 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1310988078", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-710989458", "security_groups": [{"name": "tempest-secgroup-smoke-152893613"}], "block_device_mapping_v2": [{"uuid": "a7e74967-3ece-47c4-879f-0b6ef62355fa", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "7bcf169f-11e9-43c3-9cd8-36fa37c1812f"}]}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:12:09.128171 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.network.neutron [None req-28190264-c4f6-4d09-a1f9-f8920de6d901 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] validate_networks() for [('7bcf169f-11e9-43c3-9cd8-36fa37c1812f', None, None, None, None, None)] {{(pid=116375) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Jan 28 02:12:09.580789 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.virt.hardware [None req-28190264-c4f6-4d09-a1f9-f8920de6d901 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Flavor limits 0:0:0 {{(pid=116375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 02:12:09.581237 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.virt.hardware [None req-28190264-c4f6-4d09-a1f9-f8920de6d901 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Image limits 0:0:0 {{(pid=116375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 02:12:09.581706 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.virt.hardware [None req-28190264-c4f6-4d09-a1f9-f8920de6d901 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Flavor pref 0:0:0 {{(pid=116375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 02:12:09.582388 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.virt.hardware [None req-28190264-c4f6-4d09-a1f9-f8920de6d901 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Image pref 0:0:0 {{(pid=116375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 02:12:09.582519 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.virt.hardware [None req-28190264-c4f6-4d09-a1f9-f8920de6d901 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 02:12:09.592251 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-28190264-c4f6-4d09-a1f9-f8920de6d901 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:09.592698 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-28190264-c4f6-4d09-a1f9-f8920de6d901 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:09.593492 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-28190264-c4f6-4d09-a1f9-f8920de6d901 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:09.593924 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-28190264-c4f6-4d09-a1f9-f8920de6d901 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:09.609802 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.quota [None req-28190264-c4f6-4d09-a1f9-f8920de6d901 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Getting quotas for project 7ed8db325d13496c9a417966e33b10a1. Resources: {'ram', 'cores', 'instances'} {{(pid=116375) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 02:12:09.614218 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.quota [None req-28190264-c4f6-4d09-a1f9-f8920de6d901 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Getting quotas for user 4cdbf7d369e4437eae7a36529d6cd623 and project 7ed8db325d13496c9a417966e33b10a1. Resources: {'ram', 'cores', 'instances'} {{(pid=116375) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 02:12:09.672885 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-28190264-c4f6-4d09-a1f9-f8920de6d901 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Going to run 1 instances... {{(pid=116375) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 02:12:09.674931 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-28190264-c4f6-4d09-a1f9-f8920de6d901 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] [instance: c405e3d0-6da8-4dac-9dc9-0c084024bb9f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a7e74967-3ece-47c4-879f-0b6ef62355fa',volume_size=None,volume_type=None)] {{(pid=116375) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 02:12:09.752404 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-7a9bfa4f-bfdb-41e4-86d2-b50de494d9a0 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:12:09.753089 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-7a9bfa4f-bfdb-41e4-86d2-b50de494d9a0 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: c3ea23ca-a790-4f52-ad85-dcac640a8695] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:09.759396 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-7a9bfa4f-bfdb-41e4-86d2-b50de494d9a0 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:09.759835 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-7a9bfa4f-bfdb-41e4-86d2-b50de494d9a0 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:09.761435 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-7a9bfa4f-bfdb-41e4-86d2-b50de494d9a0 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:09.761910 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-7a9bfa4f-bfdb-41e4-86d2-b50de494d9a0 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:09.884579 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-7a9bfa4f-bfdb-41e4-86d2-b50de494d9a0 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:09.893374 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-7a9bfa4f-bfdb-41e4-86d2-b50de494d9a0 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:09.896859 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-7a9bfa4f-bfdb-41e4-86d2-b50de494d9a0 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:09.896859 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-7a9bfa4f-bfdb-41e4-86d2-b50de494d9a0 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695" status: 200 len: 1721 microversion: 2.20 time: 0.147817 Jan 28 02:12:09.896859 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 477/916] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:12:09 2022] GET /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695 => generated 1721 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 02:12:10.008763 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-c45a0064-5a72-44ae-901a-d3c17a259520 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:12:10.009708 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-c45a0064-5a72-44ae-901a-d3c17a259520 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:10.016336 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-c45a0064-5a72-44ae-901a-d3c17a259520 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:10.017226 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-c45a0064-5a72-44ae-901a-d3c17a259520 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:10.017681 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-c45a0064-5a72-44ae-901a-d3c17a259520 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:10.018011 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-c45a0064-5a72-44ae-901a-d3c17a259520 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:10.050620 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-28190264-c4f6-4d09-a1f9-f8920de6d901 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.033792 Jan 28 02:12:10.051267 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 440/917] 10.222.0.79 () {60 vars in 1146 bytes} [Fri Jan 28 02:12:09 2022] POST /compute/v2.1/servers => generated 405 bytes in 1035 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 28 02:12:10.061324 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-94272d86-27dd-4ee0-8b39-a8edbef181f0 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:12:10.061917 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-94272d86-27dd-4ee0-8b39-a8edbef181f0 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] [instance: c405e3d0-6da8-4dac-9dc9-0c084024bb9f] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:10.117841 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-94272d86-27dd-4ee0-8b39-a8edbef181f0 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cdbf7d369e4437eae7a36529d6cd623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed8db325d13496c9a417966e33b10a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:10.126662 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-94272d86-27dd-4ee0-8b39-a8edbef181f0 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] 10.222.0.79 "GET /compute/v2.1/servers/c405e3d0-6da8-4dac-9dc9-0c084024bb9f" status: 200 len: 1094 microversion: 2.1 time: 0.069496 Jan 28 02:12:10.126815 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-c45a0064-5a72-44ae-901a-d3c17a259520 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "POST /compute/v2.1/servers/ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc/action" status: 200 len: 22322 microversion: 2.1 time: 0.121474 Jan 28 02:12:10.127472 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 441/918] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:12:10 2022] GET /compute/v2.1/servers/c405e3d0-6da8-4dac-9dc9-0c084024bb9f => generated 1094 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:12:10.127599 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 478/919] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Jan 28 02:12:10 2022] POST /compute/v2.1/servers/ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc/action => generated 22322 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 02:12:10.913816 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-bf641a8c-09b0-49ff-8451-205824bfbb82 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:12:10.914447 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-bf641a8c-09b0-49ff-8451-205824bfbb82 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: c3ea23ca-a790-4f52-ad85-dcac640a8695] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:10.921112 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-bf641a8c-09b0-49ff-8451-205824bfbb82 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:10.921553 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-bf641a8c-09b0-49ff-8451-205824bfbb82 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:10.922308 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-bf641a8c-09b0-49ff-8451-205824bfbb82 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:10.922734 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-bf641a8c-09b0-49ff-8451-205824bfbb82 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:11.041114 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-bf641a8c-09b0-49ff-8451-205824bfbb82 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:11.049196 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-bf641a8c-09b0-49ff-8451-205824bfbb82 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:11.050661 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-bf641a8c-09b0-49ff-8451-205824bfbb82 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:11.051880 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-bf641a8c-09b0-49ff-8451-205824bfbb82 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695" status: 200 len: 1721 microversion: 2.20 time: 0.141778 Jan 28 02:12:11.052473 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 442/920] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:12:10 2022] GET /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695 => generated 1721 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:12:11.139008 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-d99bb133-1450-4a61-b545-96e5a95eb8cf tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:12:11.140025 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-d99bb133-1450-4a61-b545-96e5a95eb8cf tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:11.143611 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-c9716242-2f5b-4483-8f87-017747cf20dd tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:12:11.144376 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-c9716242-2f5b-4483-8f87-017747cf20dd tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] [instance: c405e3d0-6da8-4dac-9dc9-0c084024bb9f] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:11.146517 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-d99bb133-1450-4a61-b545-96e5a95eb8cf tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:11.146966 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-d99bb133-1450-4a61-b545-96e5a95eb8cf tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:11.147732 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-d99bb133-1450-4a61-b545-96e5a95eb8cf tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:11.148196 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-d99bb133-1450-4a61-b545-96e5a95eb8cf tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:11.150525 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c9716242-2f5b-4483-8f87-017747cf20dd tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:11.151000 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c9716242-2f5b-4483-8f87-017747cf20dd tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:11.152553 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c9716242-2f5b-4483-8f87-017747cf20dd tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:11.152553 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c9716242-2f5b-4483-8f87-017747cf20dd tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:11.213645 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-c9716242-2f5b-4483-8f87-017747cf20dd tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cdbf7d369e4437eae7a36529d6cd623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed8db325d13496c9a417966e33b10a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:11.221235 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-c9716242-2f5b-4483-8f87-017747cf20dd tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] 10.222.0.79 "GET /compute/v2.1/servers/c405e3d0-6da8-4dac-9dc9-0c084024bb9f" status: 200 len: 1144 microversion: 2.1 time: 0.081235 Jan 28 02:12:11.221803 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 443/921] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:12:11 2022] GET /compute/v2.1/servers/c405e3d0-6da8-4dac-9dc9-0c084024bb9f => generated 1144 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:12:11.275207 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-d99bb133-1450-4a61-b545-96e5a95eb8cf tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "POST /compute/v2.1/servers/ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc/action" status: 200 len: 23798 microversion: 2.1 time: 0.140617 Jan 28 02:12:11.275825 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 479/922] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Jan 28 02:12:11 2022] POST /compute/v2.1/servers/ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc/action => generated 23798 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 02:12:12.070547 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-d0b57675-3056-44f7-8f03-d30e822e7f00 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:12:12.071146 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-d0b57675-3056-44f7-8f03-d30e822e7f00 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: c3ea23ca-a790-4f52-ad85-dcac640a8695] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:12.077778 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-d0b57675-3056-44f7-8f03-d30e822e7f00 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:12.078221 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-d0b57675-3056-44f7-8f03-d30e822e7f00 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:12.078998 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-d0b57675-3056-44f7-8f03-d30e822e7f00 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:12.079424 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-d0b57675-3056-44f7-8f03-d30e822e7f00 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:12.239264 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-ae8db023-665a-47f4-acfa-e1c5810dca8d tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:12:12.240364 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-ae8db023-665a-47f4-acfa-e1c5810dca8d tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] [instance: c405e3d0-6da8-4dac-9dc9-0c084024bb9f] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:12.247280 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-ae8db023-665a-47f4-acfa-e1c5810dca8d tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:12.247851 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-ae8db023-665a-47f4-acfa-e1c5810dca8d tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:12.248749 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-ae8db023-665a-47f4-acfa-e1c5810dca8d tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:12.249278 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-ae8db023-665a-47f4-acfa-e1c5810dca8d tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:12.258182 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-d0b57675-3056-44f7-8f03-d30e822e7f00 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:12.270710 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-d0b57675-3056-44f7-8f03-d30e822e7f00 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:12.272243 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-d0b57675-3056-44f7-8f03-d30e822e7f00 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:12.273400 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-d0b57675-3056-44f7-8f03-d30e822e7f00 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695" status: 200 len: 1721 microversion: 2.20 time: 0.206636 Jan 28 02:12:12.284177 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 444/923] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:12:12 2022] GET /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695 => generated 1721 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:12:12.289704 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-b0bbe26f-e9ab-48d2-aeed-5159c0575f3c tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:12:12.290675 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-b0bbe26f-e9ab-48d2-aeed-5159c0575f3c tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:12.297442 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b0bbe26f-e9ab-48d2-aeed-5159c0575f3c tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:12.297898 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b0bbe26f-e9ab-48d2-aeed-5159c0575f3c tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:12.298669 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b0bbe26f-e9ab-48d2-aeed-5159c0575f3c tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:12.299098 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b0bbe26f-e9ab-48d2-aeed-5159c0575f3c tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:12.344668 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-ae8db023-665a-47f4-acfa-e1c5810dca8d tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cdbf7d369e4437eae7a36529d6cd623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed8db325d13496c9a417966e33b10a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:12.352286 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-ae8db023-665a-47f4-acfa-e1c5810dca8d tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] 10.222.0.79 "GET /compute/v2.1/servers/c405e3d0-6da8-4dac-9dc9-0c084024bb9f" status: 200 len: 1200 microversion: 2.1 time: 0.117230 Jan 28 02:12:12.353233 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 480/924] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:12:12 2022] GET /compute/v2.1/servers/c405e3d0-6da8-4dac-9dc9-0c084024bb9f => generated 1200 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:12:12.411173 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-b0bbe26f-e9ab-48d2-aeed-5159c0575f3c tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "POST /compute/v2.1/servers/ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc/action" status: 200 len: 24971 microversion: 2.1 time: 0.127277 Jan 28 02:12:12.415072 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 445/925] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Jan 28 02:12:12 2022] POST /compute/v2.1/servers/ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc/action => generated 24971 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 02:12:13.292744 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-080e3cd1-4d95-432c-8e47-5e99801e7f32 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:12:13.293359 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-080e3cd1-4d95-432c-8e47-5e99801e7f32 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: c3ea23ca-a790-4f52-ad85-dcac640a8695] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:13.299522 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-080e3cd1-4d95-432c-8e47-5e99801e7f32 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:13.299958 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-080e3cd1-4d95-432c-8e47-5e99801e7f32 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:13.300759 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-080e3cd1-4d95-432c-8e47-5e99801e7f32 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:13.301179 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-080e3cd1-4d95-432c-8e47-5e99801e7f32 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:13.369789 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-becf3031-5fca-4f09-bcbe-091ea6af8b62 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:12:13.371014 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-becf3031-5fca-4f09-bcbe-091ea6af8b62 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] [instance: c405e3d0-6da8-4dac-9dc9-0c084024bb9f] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:13.377785 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-becf3031-5fca-4f09-bcbe-091ea6af8b62 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:13.378226 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-becf3031-5fca-4f09-bcbe-091ea6af8b62 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:13.378994 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-becf3031-5fca-4f09-bcbe-091ea6af8b62 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:13.380016 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-becf3031-5fca-4f09-bcbe-091ea6af8b62 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:13.530421 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-080e3cd1-4d95-432c-8e47-5e99801e7f32 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:13.540284 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-080e3cd1-4d95-432c-8e47-5e99801e7f32 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:13.541951 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-080e3cd1-4d95-432c-8e47-5e99801e7f32 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:13.543162 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-080e3cd1-4d95-432c-8e47-5e99801e7f32 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695" status: 200 len: 1721 microversion: 2.20 time: 0.254183 Jan 28 02:12:13.544026 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 481/926] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:12:13 2022] GET /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695 => generated 1721 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:12:13.548354 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-b0642e03-dfae-4f46-9fc2-ebd863815d89 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:12:13.549261 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-b0642e03-dfae-4f46-9fc2-ebd863815d89 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:13.555001 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-b0642e03-dfae-4f46-9fc2-ebd863815d89 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:13.559876 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-b0642e03-dfae-4f46-9fc2-ebd863815d89 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:13.559876 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-b0642e03-dfae-4f46-9fc2-ebd863815d89 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:13.559876 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-b0642e03-dfae-4f46-9fc2-ebd863815d89 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:13.611651 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-becf3031-5fca-4f09-bcbe-091ea6af8b62 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cdbf7d369e4437eae7a36529d6cd623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed8db325d13496c9a417966e33b10a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:13.619259 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-becf3031-5fca-4f09-bcbe-091ea6af8b62 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] 10.222.0.79 "GET /compute/v2.1/servers/c405e3d0-6da8-4dac-9dc9-0c084024bb9f" status: 200 len: 1277 microversion: 2.1 time: 0.253659 Jan 28 02:12:13.623686 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 446/927] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:12:13 2022] GET /compute/v2.1/servers/c405e3d0-6da8-4dac-9dc9-0c084024bb9f => generated 1277 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:12:13.658804 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-b0642e03-dfae-4f46-9fc2-ebd863815d89 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "POST /compute/v2.1/servers/ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc/action" status: 200 len: 26453 microversion: 2.1 time: 0.113744 Jan 28 02:12:13.660023 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 482/928] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Jan 28 02:12:13 2022] POST /compute/v2.1/servers/ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc/action => generated 26453 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 02:12:14.036848 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [req-4cd32146-e00c-4a3d-a39e-9d6c930044b8 req-c2f52978-31d2-4778-9d24-096d5c5456c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c405e3d0-6da8-4dac-9dc9-0c084024bb9f", "tag": "972d33d2-8e4d-4169-af65-29a82d02d383"}]} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:12:14.038332 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:12:14.038332 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: warnings.warn(msg) Jan 28 02:12:14.059280 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-4cd32146-e00c-4a3d-a39e-9d6c930044b8 req-c2f52978-31d2-4778-9d24-096d5c5456c5 service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:14.059280 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-4cd32146-e00c-4a3d-a39e-9d6c930044b8 req-c2f52978-31d2-4778-9d24-096d5c5456c5 service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:14.064514 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.compute.server_external_events [req-4cd32146-e00c-4a3d-a39e-9d6c930044b8 req-c2f52978-31d2-4778-9d24-096d5c5456c5 service nova] Creating event network-changed:972d33d2-8e4d-4169-af65-29a82d02d383 for instance c405e3d0-6da8-4dac-9dc9-0c084024bb9f on hv-cinder-82497 Jan 28 02:12:14.070018 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [req-4cd32146-e00c-4a3d-a39e-9d6c930044b8 req-c2f52978-31d2-4778-9d24-096d5c5456c5 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036766 Jan 28 02:12:14.070612 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 447/929] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Jan 28 02:12:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:12:14.562541 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-b79e6d74-ffbd-4d32-ac77-0a9d67ac3a4f tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:12:14.563843 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-b79e6d74-ffbd-4d32-ac77-0a9d67ac3a4f tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: c3ea23ca-a790-4f52-ad85-dcac640a8695] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:14.571122 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-b79e6d74-ffbd-4d32-ac77-0a9d67ac3a4f tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:14.571567 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-b79e6d74-ffbd-4d32-ac77-0a9d67ac3a4f tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:14.572374 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-b79e6d74-ffbd-4d32-ac77-0a9d67ac3a4f tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:14.573870 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-b79e6d74-ffbd-4d32-ac77-0a9d67ac3a4f tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:14.641254 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-e00242b8-d56a-46d6-aeda-198f04dabb26 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:12:14.641254 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-e00242b8-d56a-46d6-aeda-198f04dabb26 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] [instance: c405e3d0-6da8-4dac-9dc9-0c084024bb9f] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:14.644639 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-e00242b8-d56a-46d6-aeda-198f04dabb26 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:14.645148 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-e00242b8-d56a-46d6-aeda-198f04dabb26 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:14.645973 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-e00242b8-d56a-46d6-aeda-198f04dabb26 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:14.646486 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-e00242b8-d56a-46d6-aeda-198f04dabb26 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:14.813434 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-b79e6d74-ffbd-4d32-ac77-0a9d67ac3a4f tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:14.821180 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-b79e6d74-ffbd-4d32-ac77-0a9d67ac3a4f tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:14.822676 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-b79e6d74-ffbd-4d32-ac77-0a9d67ac3a4f tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:14.824342 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-b79e6d74-ffbd-4d32-ac77-0a9d67ac3a4f tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695" status: 200 len: 1721 microversion: 2.20 time: 0.266541 Jan 28 02:12:14.824932 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 483/930] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:12:14 2022] GET /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695 => generated 1721 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:12:14.838370 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-745e1414-3cd7-4364-a18d-8045078f35f1 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:12:14.840182 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-745e1414-3cd7-4364-a18d-8045078f35f1 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:14.845937 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-745e1414-3cd7-4364-a18d-8045078f35f1 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:14.846634 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-745e1414-3cd7-4364-a18d-8045078f35f1 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:14.847399 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-745e1414-3cd7-4364-a18d-8045078f35f1 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:14.847829 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-745e1414-3cd7-4364-a18d-8045078f35f1 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:14.894846 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-e00242b8-d56a-46d6-aeda-198f04dabb26 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cdbf7d369e4437eae7a36529d6cd623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed8db325d13496c9a417966e33b10a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:14.902975 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-e00242b8-d56a-46d6-aeda-198f04dabb26 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] 10.222.0.79 "GET /compute/v2.1/servers/c405e3d0-6da8-4dac-9dc9-0c084024bb9f" status: 200 len: 1265 microversion: 2.1 time: 0.269803 Jan 28 02:12:14.903541 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 448/931] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:12:14 2022] GET /compute/v2.1/servers/c405e3d0-6da8-4dac-9dc9-0c084024bb9f => generated 1265 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:12:14.950674 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-745e1414-3cd7-4364-a18d-8045078f35f1 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "POST /compute/v2.1/servers/ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc/action" status: 200 len: 27464 microversion: 2.1 time: 0.124204 Jan 28 02:12:14.954576 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 484/932] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Jan 28 02:12:14 2022] POST /compute/v2.1/servers/ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc/action => generated 27464 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 02:12:15.843235 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-5a0ced86-6dbd-43b3-a956-82534c8e12f8 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:12:15.843869 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-5a0ced86-6dbd-43b3-a956-82534c8e12f8 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: c3ea23ca-a790-4f52-ad85-dcac640a8695] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:15.849941 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-5a0ced86-6dbd-43b3-a956-82534c8e12f8 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:15.850418 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-5a0ced86-6dbd-43b3-a956-82534c8e12f8 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:15.851185 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-5a0ced86-6dbd-43b3-a956-82534c8e12f8 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:15.851619 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-5a0ced86-6dbd-43b3-a956-82534c8e12f8 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:15.921149 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-661eeae3-1496-404f-9d99-0335292e5142 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:12:15.921840 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-661eeae3-1496-404f-9d99-0335292e5142 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] [instance: c405e3d0-6da8-4dac-9dc9-0c084024bb9f] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:15.929384 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-661eeae3-1496-404f-9d99-0335292e5142 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:15.929822 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-661eeae3-1496-404f-9d99-0335292e5142 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:15.930586 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-661eeae3-1496-404f-9d99-0335292e5142 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:15.931013 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-661eeae3-1496-404f-9d99-0335292e5142 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:15.998651 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-5a0ced86-6dbd-43b3-a956-82534c8e12f8 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:16.006580 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-5a0ced86-6dbd-43b3-a956-82534c8e12f8 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:16.008093 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-5a0ced86-6dbd-43b3-a956-82534c8e12f8 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:16.009239 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-5a0ced86-6dbd-43b3-a956-82534c8e12f8 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695" status: 200 len: 1742 microversion: 2.20 time: 0.170582 Jan 28 02:12:16.009794 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 449/933] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:12:15 2022] GET /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695 => generated 1742 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:12:16.014875 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-b0cd395f-3636-42e2-8640-74cb8012ab19 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:12:16.016102 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-b0cd395f-3636-42e2-8640-74cb8012ab19 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:16.021788 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b0cd395f-3636-42e2-8640-74cb8012ab19 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:16.022227 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b0cd395f-3636-42e2-8640-74cb8012ab19 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:16.022986 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b0cd395f-3636-42e2-8640-74cb8012ab19 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:16.023409 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b0cd395f-3636-42e2-8640-74cb8012ab19 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:16.142411 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-b0cd395f-3636-42e2-8640-74cb8012ab19 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "POST /compute/v2.1/servers/ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc/action" status: 200 len: 27773 microversion: 2.1 time: 0.131367 Jan 28 02:12:16.145537 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 450/934] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Jan 28 02:12:16 2022] POST /compute/v2.1/servers/ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc/action => generated 27773 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 02:12:16.330267 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-661eeae3-1496-404f-9d99-0335292e5142 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cdbf7d369e4437eae7a36529d6cd623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed8db325d13496c9a417966e33b10a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:16.337472 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-661eeae3-1496-404f-9d99-0335292e5142 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] 10.222.0.79 "GET /compute/v2.1/servers/c405e3d0-6da8-4dac-9dc9-0c084024bb9f" status: 200 len: 1265 microversion: 2.1 time: 0.421524 Jan 28 02:12:16.338032 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 485/935] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:12:15 2022] GET /compute/v2.1/servers/c405e3d0-6da8-4dac-9dc9-0c084024bb9f => generated 1265 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:12:17.029873 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-066130a9-4f2d-4561-90f8-a97c161551d3 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:12:17.030598 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-066130a9-4f2d-4561-90f8-a97c161551d3 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: c3ea23ca-a790-4f52-ad85-dcac640a8695] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:17.037248 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-066130a9-4f2d-4561-90f8-a97c161551d3 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:17.037694 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-066130a9-4f2d-4561-90f8-a97c161551d3 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:17.038462 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-066130a9-4f2d-4561-90f8-a97c161551d3 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:17.038897 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-066130a9-4f2d-4561-90f8-a97c161551d3 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:17.156289 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-00b037df-a55a-4765-b565-edcd1d16d5fa tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:12:17.157233 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-00b037df-a55a-4765-b565-edcd1d16d5fa tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:17.161471 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-066130a9-4f2d-4561-90f8-a97c161551d3 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:17.163661 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-00b037df-a55a-4765-b565-edcd1d16d5fa tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:17.164142 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-00b037df-a55a-4765-b565-edcd1d16d5fa tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:17.164920 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-00b037df-a55a-4765-b565-edcd1d16d5fa tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:17.165352 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-00b037df-a55a-4765-b565-edcd1d16d5fa tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:17.169126 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-066130a9-4f2d-4561-90f8-a97c161551d3 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:17.170599 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-066130a9-4f2d-4561-90f8-a97c161551d3 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:17.171739 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-066130a9-4f2d-4561-90f8-a97c161551d3 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695" status: 200 len: 1742 microversion: 2.20 time: 0.146811 Jan 28 02:12:17.172380 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 451/936] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:12:17 2022] GET /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695 => generated 1742 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:12:17.275823 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-00b037df-a55a-4765-b565-edcd1d16d5fa tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "POST /compute/v2.1/servers/ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc/action" status: 200 len: 28193 microversion: 2.1 time: 0.123024 Jan 28 02:12:17.276394 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 486/937] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Jan 28 02:12:17 2022] POST /compute/v2.1/servers/ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc/action => generated 28193 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 02:12:17.354255 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-bd5c9cf6-fd06-40da-bdde-cce4311b5bc3 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:12:17.354855 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-bd5c9cf6-fd06-40da-bdde-cce4311b5bc3 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] [instance: c405e3d0-6da8-4dac-9dc9-0c084024bb9f] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:17.361627 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-bd5c9cf6-fd06-40da-bdde-cce4311b5bc3 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:17.362096 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-bd5c9cf6-fd06-40da-bdde-cce4311b5bc3 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:17.362854 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-bd5c9cf6-fd06-40da-bdde-cce4311b5bc3 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:17.363284 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-bd5c9cf6-fd06-40da-bdde-cce4311b5bc3 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:17.485188 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-bd5c9cf6-fd06-40da-bdde-cce4311b5bc3 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cdbf7d369e4437eae7a36529d6cd623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed8db325d13496c9a417966e33b10a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:17.492641 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [req-49b7178f-b3f3-4daf-a3c6-4bd77b1cac1e req-fe7a259d-fd60-48b9-9827-98fa561ce443 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3ea23ca-a790-4f52-ad85-dcac640a8695", "name": "network-vif-plugged", "status": "completed", "tag": "a5ba13e6-3134-4ccb-b060-70df55025709"}]} {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:12:17.493519 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-bd5c9cf6-fd06-40da-bdde-cce4311b5bc3 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] 10.222.0.79 "GET /compute/v2.1/servers/c405e3d0-6da8-4dac-9dc9-0c084024bb9f" status: 200 len: 1265 microversion: 2.1 time: 0.142146 Jan 28 02:12:17.493519 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 452/938] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:12:17 2022] GET /compute/v2.1/servers/c405e3d0-6da8-4dac-9dc9-0c084024bb9f => generated 1265 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:12:17.494741 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:12:17.494741 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: warnings.warn(msg) Jan 28 02:12:17.502820 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [req-49b7178f-b3f3-4daf-a3c6-4bd77b1cac1e req-fe7a259d-fd60-48b9-9827-98fa561ce443 service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:17.503327 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [req-49b7178f-b3f3-4daf-a3c6-4bd77b1cac1e req-fe7a259d-fd60-48b9-9827-98fa561ce443 service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:17.514017 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.compute.server_external_events [req-49b7178f-b3f3-4daf-a3c6-4bd77b1cac1e req-fe7a259d-fd60-48b9-9827-98fa561ce443 service nova] Creating event network-vif-plugged:a5ba13e6-3134-4ccb-b060-70df55025709 for instance c3ea23ca-a790-4f52-ad85-dcac640a8695 on hv-cinder-82497 Jan 28 02:12:17.519103 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [req-49b7178f-b3f3-4daf-a3c6-4bd77b1cac1e req-fe7a259d-fd60-48b9-9827-98fa561ce443 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030552 Jan 28 02:12:17.519756 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 487/939] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Jan 28 02:12:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:12:18.190147 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-369cc9ab-2ea5-4d34-86b1-db497b74e447 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:12:18.190777 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-369cc9ab-2ea5-4d34-86b1-db497b74e447 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: c3ea23ca-a790-4f52-ad85-dcac640a8695] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:18.196994 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-369cc9ab-2ea5-4d34-86b1-db497b74e447 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:18.197437 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-369cc9ab-2ea5-4d34-86b1-db497b74e447 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:18.198220 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-369cc9ab-2ea5-4d34-86b1-db497b74e447 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:18.198654 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-369cc9ab-2ea5-4d34-86b1-db497b74e447 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:18.287743 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-0078f92f-6055-41a0-87f7-a2100550436f tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:12:18.288759 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-0078f92f-6055-41a0-87f7-a2100550436f tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:18.298833 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-0078f92f-6055-41a0-87f7-a2100550436f tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:18.299272 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-0078f92f-6055-41a0-87f7-a2100550436f tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:18.300082 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-0078f92f-6055-41a0-87f7-a2100550436f tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:18.300511 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-0078f92f-6055-41a0-87f7-a2100550436f tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:18.325615 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-369cc9ab-2ea5-4d34-86b1-db497b74e447 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:18.334532 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-369cc9ab-2ea5-4d34-86b1-db497b74e447 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:18.336052 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-369cc9ab-2ea5-4d34-86b1-db497b74e447 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:18.337206 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-369cc9ab-2ea5-4d34-86b1-db497b74e447 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695" status: 200 len: 1737 microversion: 2.20 time: 0.150979 Jan 28 02:12:18.337763 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 453/940] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:12:18 2022] GET /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695 => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:12:18.391268 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-0078f92f-6055-41a0-87f7-a2100550436f tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "POST /compute/v2.1/servers/ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc/action" status: 200 len: 28193 microversion: 2.1 time: 0.107456 Jan 28 02:12:18.392229 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 488/941] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Jan 28 02:12:18 2022] POST /compute/v2.1/servers/ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc/action => generated 28193 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 02:12:18.509663 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-5fffe5cf-483e-4928-9aea-8b852b53464d tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:12:18.510278 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-5fffe5cf-483e-4928-9aea-8b852b53464d tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] [instance: c405e3d0-6da8-4dac-9dc9-0c084024bb9f] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:18.516764 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-5fffe5cf-483e-4928-9aea-8b852b53464d tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:18.517216 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-5fffe5cf-483e-4928-9aea-8b852b53464d tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:18.517995 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-5fffe5cf-483e-4928-9aea-8b852b53464d tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:18.518428 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-5fffe5cf-483e-4928-9aea-8b852b53464d tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:18.641311 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-5fffe5cf-483e-4928-9aea-8b852b53464d tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cdbf7d369e4437eae7a36529d6cd623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed8db325d13496c9a417966e33b10a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:18.649830 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-5fffe5cf-483e-4928-9aea-8b852b53464d tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] 10.222.0.79 "GET /compute/v2.1/servers/c405e3d0-6da8-4dac-9dc9-0c084024bb9f" status: 200 len: 1265 microversion: 2.1 time: 0.144009 Jan 28 02:12:18.650395 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 454/942] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:12:18 2022] GET /compute/v2.1/servers/c405e3d0-6da8-4dac-9dc9-0c084024bb9f => generated 1265 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:12:19.358813 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-317446c6-217e-499d-9ad0-e9951b939405 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:12:19.360432 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-317446c6-217e-499d-9ad0-e9951b939405 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: c3ea23ca-a790-4f52-ad85-dcac640a8695] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:19.368245 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-317446c6-217e-499d-9ad0-e9951b939405 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:19.368991 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-317446c6-217e-499d-9ad0-e9951b939405 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:19.369897 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-317446c6-217e-499d-9ad0-e9951b939405 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:19.370437 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-317446c6-217e-499d-9ad0-e9951b939405 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:19.415823 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-56ce0427-c5b9-47cf-af90-9a2aff8d0436 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:12:19.423216 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-56ce0427-c5b9-47cf-af90-9a2aff8d0436 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:19.430125 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-56ce0427-c5b9-47cf-af90-9a2aff8d0436 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:19.430662 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-56ce0427-c5b9-47cf-af90-9a2aff8d0436 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:19.431341 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-56ce0427-c5b9-47cf-af90-9a2aff8d0436 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:19.431779 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-56ce0427-c5b9-47cf-af90-9a2aff8d0436 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:19.536042 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-317446c6-217e-499d-9ad0-e9951b939405 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:19.547205 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-56ce0427-c5b9-47cf-af90-9a2aff8d0436 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "POST /compute/v2.1/servers/ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc/action" status: 200 len: 28193 microversion: 2.1 time: 0.136929 Jan 28 02:12:19.547875 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 455/943] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Jan 28 02:12:19 2022] POST /compute/v2.1/servers/ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc/action => generated 28193 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 02:12:19.554351 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-317446c6-217e-499d-9ad0-e9951b939405 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:19.555852 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-317446c6-217e-499d-9ad0-e9951b939405 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:19.558418 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-317446c6-217e-499d-9ad0-e9951b939405 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695" status: 200 len: 1737 microversion: 2.20 time: 0.205246 Jan 28 02:12:19.559133 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 489/944] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:12:19 2022] GET /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695 => generated 1737 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:12:19.670383 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-fb054a60-4521-4e16-85a3-4b3589fc30c5 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:12:19.672167 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-fb054a60-4521-4e16-85a3-4b3589fc30c5 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] [instance: c405e3d0-6da8-4dac-9dc9-0c084024bb9f] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:19.681895 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-fb054a60-4521-4e16-85a3-4b3589fc30c5 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:19.682340 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-fb054a60-4521-4e16-85a3-4b3589fc30c5 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:19.683113 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-fb054a60-4521-4e16-85a3-4b3589fc30c5 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:19.683550 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-fb054a60-4521-4e16-85a3-4b3589fc30c5 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:19.850109 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-fb054a60-4521-4e16-85a3-4b3589fc30c5 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cdbf7d369e4437eae7a36529d6cd623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed8db325d13496c9a417966e33b10a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:19.858702 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-fb054a60-4521-4e16-85a3-4b3589fc30c5 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] 10.222.0.79 "GET /compute/v2.1/servers/c405e3d0-6da8-4dac-9dc9-0c084024bb9f" status: 200 len: 1265 microversion: 2.1 time: 0.194774 Jan 28 02:12:19.860316 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 456/945] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:12:19 2022] GET /compute/v2.1/servers/c405e3d0-6da8-4dac-9dc9-0c084024bb9f => generated 1265 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:12:20.566032 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-0dea1e79-7d08-4318-a108-a9d636ff1dd5 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:12:20.568208 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-0dea1e79-7d08-4318-a108-a9d636ff1dd5 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:20.577324 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-ee45b416-78a5-455e-9718-1105314b67dc tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:12:20.578486 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-ee45b416-78a5-455e-9718-1105314b67dc tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: c3ea23ca-a790-4f52-ad85-dcac640a8695] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:20.586084 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ee45b416-78a5-455e-9718-1105314b67dc tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:20.588492 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-0dea1e79-7d08-4318-a108-a9d636ff1dd5 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:20.589155 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ee45b416-78a5-455e-9718-1105314b67dc tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:20.590179 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ee45b416-78a5-455e-9718-1105314b67dc tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:20.590861 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-0dea1e79-7d08-4318-a108-a9d636ff1dd5 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:20.591679 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-0dea1e79-7d08-4318-a108-a9d636ff1dd5 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:20.592201 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ee45b416-78a5-455e-9718-1105314b67dc tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:20.593547 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-0dea1e79-7d08-4318-a108-a9d636ff1dd5 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:20.726876 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-0dea1e79-7d08-4318-a108-a9d636ff1dd5 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "POST /compute/v2.1/servers/ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc/action" status: 200 len: 28193 microversion: 2.1 time: 0.171457 Jan 28 02:12:20.727543 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 490/946] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Jan 28 02:12:20 2022] POST /compute/v2.1/servers/ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc/action => generated 28193 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 02:12:20.754737 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-ee45b416-78a5-455e-9718-1105314b67dc tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:20.765259 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-ee45b416-78a5-455e-9718-1105314b67dc tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:20.767004 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-ee45b416-78a5-455e-9718-1105314b67dc tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:20.768452 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-ee45b416-78a5-455e-9718-1105314b67dc tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695" status: 200 len: 1737 microversion: 2.20 time: 0.195647 Jan 28 02:12:20.769252 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 457/947] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:12:20 2022] GET /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695 => generated 1737 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 02:12:20.878563 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-47db546f-d1d0-4c43-b639-6d64521ce540 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:12:20.879203 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-47db546f-d1d0-4c43-b639-6d64521ce540 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] [instance: c405e3d0-6da8-4dac-9dc9-0c084024bb9f] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:20.886472 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-47db546f-d1d0-4c43-b639-6d64521ce540 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:20.886923 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-47db546f-d1d0-4c43-b639-6d64521ce540 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:20.887735 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-47db546f-d1d0-4c43-b639-6d64521ce540 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:20.888199 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-47db546f-d1d0-4c43-b639-6d64521ce540 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:21.021703 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-47db546f-d1d0-4c43-b639-6d64521ce540 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cdbf7d369e4437eae7a36529d6cd623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed8db325d13496c9a417966e33b10a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:21.029173 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-47db546f-d1d0-4c43-b639-6d64521ce540 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] 10.222.0.79 "GET /compute/v2.1/servers/c405e3d0-6da8-4dac-9dc9-0c084024bb9f" status: 200 len: 1265 microversion: 2.1 time: 0.155470 Jan 28 02:12:21.033704 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 491/948] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:12:20 2022] GET /compute/v2.1/servers/c405e3d0-6da8-4dac-9dc9-0c084024bb9f => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:12:21.740206 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-1f81ca79-ee89-408f-aea0-98f4ec1f03f6 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:12:21.741112 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-1f81ca79-ee89-408f-aea0-98f4ec1f03f6 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:21.746928 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-1f81ca79-ee89-408f-aea0-98f4ec1f03f6 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:21.747366 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-1f81ca79-ee89-408f-aea0-98f4ec1f03f6 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:21.748198 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-1f81ca79-ee89-408f-aea0-98f4ec1f03f6 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:21.748834 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-1f81ca79-ee89-408f-aea0-98f4ec1f03f6 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:21.786951 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-610269fb-b274-407f-9e7c-95129a315300 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:12:21.787572 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-610269fb-b274-407f-9e7c-95129a315300 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: c3ea23ca-a790-4f52-ad85-dcac640a8695] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:21.793711 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-610269fb-b274-407f-9e7c-95129a315300 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:21.840669 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-610269fb-b274-407f-9e7c-95129a315300 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:21.840669 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-610269fb-b274-407f-9e7c-95129a315300 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:21.840669 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-610269fb-b274-407f-9e7c-95129a315300 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:21.851659 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-1f81ca79-ee89-408f-aea0-98f4ec1f03f6 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "POST /compute/v2.1/servers/ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc/action" status: 200 len: 28484 microversion: 2.1 time: 0.115136 Jan 28 02:12:21.855811 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 458/949] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Jan 28 02:12:21 2022] POST /compute/v2.1/servers/ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc/action => generated 28484 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 02:12:21.923612 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-610269fb-b274-407f-9e7c-95129a315300 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:21.931330 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-610269fb-b274-407f-9e7c-95129a315300 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:21.932855 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-610269fb-b274-407f-9e7c-95129a315300 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:21.934000 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-610269fb-b274-407f-9e7c-95129a315300 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695" status: 200 len: 1737 microversion: 2.20 time: 0.150882 Jan 28 02:12:21.934566 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 492/950] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:12:21 2022] GET /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695 => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 02:12:22.046698 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-4c0eb150-15d6-4b35-901f-455db39b8d13 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:12:22.047300 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-4c0eb150-15d6-4b35-901f-455db39b8d13 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] [instance: c405e3d0-6da8-4dac-9dc9-0c084024bb9f] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:22.053792 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-4c0eb150-15d6-4b35-901f-455db39b8d13 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:22.054241 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-4c0eb150-15d6-4b35-901f-455db39b8d13 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:22.055007 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-4c0eb150-15d6-4b35-901f-455db39b8d13 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:22.055442 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-4c0eb150-15d6-4b35-901f-455db39b8d13 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:22.180970 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-4c0eb150-15d6-4b35-901f-455db39b8d13 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cdbf7d369e4437eae7a36529d6cd623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed8db325d13496c9a417966e33b10a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:22.187428 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-4c0eb150-15d6-4b35-901f-455db39b8d13 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] 10.222.0.79 "GET /compute/v2.1/servers/c405e3d0-6da8-4dac-9dc9-0c084024bb9f" status: 200 len: 1265 microversion: 2.1 time: 0.143066 Jan 28 02:12:22.188878 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 459/951] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:12:22 2022] GET /compute/v2.1/servers/c405e3d0-6da8-4dac-9dc9-0c084024bb9f => generated 1265 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:12:22.865970 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-886fbb63-7554-4e0d-9f4b-98af95a7c723 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:12:22.867508 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-886fbb63-7554-4e0d-9f4b-98af95a7c723 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:22.874716 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-886fbb63-7554-4e0d-9f4b-98af95a7c723 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:22.875445 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-886fbb63-7554-4e0d-9f4b-98af95a7c723 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:22.876257 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-886fbb63-7554-4e0d-9f4b-98af95a7c723 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:22.876687 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-886fbb63-7554-4e0d-9f4b-98af95a7c723 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:22.952611 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-7661fc93-e84b-47b6-b259-ded708d51044 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:12:22.953469 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-7661fc93-e84b-47b6-b259-ded708d51044 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: c3ea23ca-a790-4f52-ad85-dcac640a8695] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:22.960546 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-7661fc93-e84b-47b6-b259-ded708d51044 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:22.960990 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-7661fc93-e84b-47b6-b259-ded708d51044 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:22.961762 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-7661fc93-e84b-47b6-b259-ded708d51044 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:22.962269 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-7661fc93-e84b-47b6-b259-ded708d51044 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:22.976700 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-886fbb63-7554-4e0d-9f4b-98af95a7c723 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "POST /compute/v2.1/servers/ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc/action" status: 200 len: 28652 microversion: 2.1 time: 0.116489 Jan 28 02:12:22.978170 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 493/952] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Jan 28 02:12:22 2022] POST /compute/v2.1/servers/ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc/action => generated 28652 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 02:12:23.114125 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-7661fc93-e84b-47b6-b259-ded708d51044 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:23.122632 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-7661fc93-e84b-47b6-b259-ded708d51044 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:23.124201 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-7661fc93-e84b-47b6-b259-ded708d51044 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:23.125373 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-7661fc93-e84b-47b6-b259-ded708d51044 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695" status: 200 len: 1737 microversion: 2.20 time: 0.176414 Jan 28 02:12:23.126124 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 460/953] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:12:22 2022] GET /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695 => generated 1737 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 02:12:23.205883 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-24d0d66e-f89b-4dda-b85d-258f2181e8d0 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:12:23.206894 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-24d0d66e-f89b-4dda-b85d-258f2181e8d0 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] [instance: c405e3d0-6da8-4dac-9dc9-0c084024bb9f] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:23.215151 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-24d0d66e-f89b-4dda-b85d-258f2181e8d0 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:23.215602 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-24d0d66e-f89b-4dda-b85d-258f2181e8d0 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:23.216604 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-24d0d66e-f89b-4dda-b85d-258f2181e8d0 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:23.217111 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-24d0d66e-f89b-4dda-b85d-258f2181e8d0 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:23.364114 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-24d0d66e-f89b-4dda-b85d-258f2181e8d0 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cdbf7d369e4437eae7a36529d6cd623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed8db325d13496c9a417966e33b10a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:23.371849 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-24d0d66e-f89b-4dda-b85d-258f2181e8d0 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] 10.222.0.79 "GET /compute/v2.1/servers/c405e3d0-6da8-4dac-9dc9-0c084024bb9f" status: 200 len: 1265 microversion: 2.1 time: 0.170388 Jan 28 02:12:23.372841 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 494/954] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:12:23 2022] GET /compute/v2.1/servers/c405e3d0-6da8-4dac-9dc9-0c084024bb9f => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:12:23.989606 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-05042ac1-0eb0-4d34-9e00-d5775512e18e tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:12:23.990847 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-05042ac1-0eb0-4d34-9e00-d5775512e18e tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:23.996991 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-05042ac1-0eb0-4d34-9e00-d5775512e18e tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:23.997466 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-05042ac1-0eb0-4d34-9e00-d5775512e18e tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:23.998241 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-05042ac1-0eb0-4d34-9e00-d5775512e18e tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:23.998816 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-05042ac1-0eb0-4d34-9e00-d5775512e18e tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:24.100982 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-05042ac1-0eb0-4d34-9e00-d5775512e18e tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "POST /compute/v2.1/servers/ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc/action" status: 200 len: 28652 microversion: 2.1 time: 0.115054 Jan 28 02:12:24.102215 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 461/955] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Jan 28 02:12:23 2022] POST /compute/v2.1/servers/ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc/action => generated 28652 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 02:12:24.150394 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-93ea4958-00e3-45aa-997f-71cd81869ef1 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:12:24.151073 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-93ea4958-00e3-45aa-997f-71cd81869ef1 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: c3ea23ca-a790-4f52-ad85-dcac640a8695] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:24.157966 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-93ea4958-00e3-45aa-997f-71cd81869ef1 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:24.158494 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-93ea4958-00e3-45aa-997f-71cd81869ef1 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:24.159341 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-93ea4958-00e3-45aa-997f-71cd81869ef1 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:24.159839 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-93ea4958-00e3-45aa-997f-71cd81869ef1 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:24.305147 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-93ea4958-00e3-45aa-997f-71cd81869ef1 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:24.314057 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-93ea4958-00e3-45aa-997f-71cd81869ef1 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:24.315305 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-93ea4958-00e3-45aa-997f-71cd81869ef1 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:24.316332 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-93ea4958-00e3-45aa-997f-71cd81869ef1 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695" status: 200 len: 1737 microversion: 2.20 time: 0.177453 Jan 28 02:12:24.328945 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 495/956] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:12:24 2022] GET /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695 => generated 1737 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:12:24.392188 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-d884f1a3-8662-4301-813b-a16f77503d1b tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:12:24.392821 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-d884f1a3-8662-4301-813b-a16f77503d1b tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] [instance: c405e3d0-6da8-4dac-9dc9-0c084024bb9f] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:24.399841 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-d884f1a3-8662-4301-813b-a16f77503d1b tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:24.400593 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-d884f1a3-8662-4301-813b-a16f77503d1b tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:24.401099 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-d884f1a3-8662-4301-813b-a16f77503d1b tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:24.401559 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-d884f1a3-8662-4301-813b-a16f77503d1b tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:24.545892 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-d884f1a3-8662-4301-813b-a16f77503d1b tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cdbf7d369e4437eae7a36529d6cd623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed8db325d13496c9a417966e33b10a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:24.553768 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-d884f1a3-8662-4301-813b-a16f77503d1b tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] 10.222.0.79 "GET /compute/v2.1/servers/c405e3d0-6da8-4dac-9dc9-0c084024bb9f" status: 200 len: 1265 microversion: 2.1 time: 0.166387 Jan 28 02:12:24.558040 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 462/957] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:12:24 2022] GET /compute/v2.1/servers/c405e3d0-6da8-4dac-9dc9-0c084024bb9f => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:12:25.120450 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-90192853-8bde-4c1b-b1ac-3d2d2dcf0a79 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:12:25.121356 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-90192853-8bde-4c1b-b1ac-3d2d2dcf0a79 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:25.128350 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-90192853-8bde-4c1b-b1ac-3d2d2dcf0a79 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:25.128790 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-90192853-8bde-4c1b-b1ac-3d2d2dcf0a79 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:25.129564 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-90192853-8bde-4c1b-b1ac-3d2d2dcf0a79 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:25.129990 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-90192853-8bde-4c1b-b1ac-3d2d2dcf0a79 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:25.233968 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-90192853-8bde-4c1b-b1ac-3d2d2dcf0a79 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "POST /compute/v2.1/servers/ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc/action" status: 200 len: 28652 microversion: 2.1 time: 0.116300 Jan 28 02:12:25.234874 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 496/958] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Jan 28 02:12:25 2022] POST /compute/v2.1/servers/ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc/action => generated 28652 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 02:12:25.334504 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-a8f29143-6b0b-4fde-af18-b3608e491fa7 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:12:25.335224 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-a8f29143-6b0b-4fde-af18-b3608e491fa7 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: c3ea23ca-a790-4f52-ad85-dcac640a8695] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:25.341785 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a8f29143-6b0b-4fde-af18-b3608e491fa7 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:25.347814 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a8f29143-6b0b-4fde-af18-b3608e491fa7 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:25.348800 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a8f29143-6b0b-4fde-af18-b3608e491fa7 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:25.349339 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a8f29143-6b0b-4fde-af18-b3608e491fa7 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:25.502905 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-a8f29143-6b0b-4fde-af18-b3608e491fa7 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:25.512186 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-a8f29143-6b0b-4fde-af18-b3608e491fa7 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:25.514161 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-a8f29143-6b0b-4fde-af18-b3608e491fa7 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:25.515167 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-a8f29143-6b0b-4fde-af18-b3608e491fa7 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695" status: 200 len: 1737 microversion: 2.20 time: 0.184343 Jan 28 02:12:25.515715 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 463/959] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:12:25 2022] GET /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695 => generated 1737 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 02:12:25.573238 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-28d4595f-fd14-4a15-b7e6-b613261144b1 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:12:25.574414 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-28d4595f-fd14-4a15-b7e6-b613261144b1 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] [instance: c405e3d0-6da8-4dac-9dc9-0c084024bb9f] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:25.582458 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-28d4595f-fd14-4a15-b7e6-b613261144b1 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:25.583033 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-28d4595f-fd14-4a15-b7e6-b613261144b1 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:25.583994 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-28d4595f-fd14-4a15-b7e6-b613261144b1 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:25.584929 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-28d4595f-fd14-4a15-b7e6-b613261144b1 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:25.750552 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-28d4595f-fd14-4a15-b7e6-b613261144b1 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cdbf7d369e4437eae7a36529d6cd623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed8db325d13496c9a417966e33b10a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:25.761969 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-28d4595f-fd14-4a15-b7e6-b613261144b1 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] 10.222.0.79 "GET /compute/v2.1/servers/c405e3d0-6da8-4dac-9dc9-0c084024bb9f" status: 200 len: 1265 microversion: 2.1 time: 0.194815 Jan 28 02:12:25.772538 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 497/960] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:12:25 2022] GET /compute/v2.1/servers/c405e3d0-6da8-4dac-9dc9-0c084024bb9f => generated 1265 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:12:25.837496 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [req-d5c1c3b7-3354-411c-8602-f7ca5fb333c7 req-6ccd01ae-3366-46c7-92a0-ada4b870cd74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c405e3d0-6da8-4dac-9dc9-0c084024bb9f", "name": "network-vif-plugged", "status": "completed", "tag": "972d33d2-8e4d-4169-af65-29a82d02d383"}]} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:12:25.839066 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:12:25.839066 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: warnings.warn(msg) Jan 28 02:12:25.847709 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-d5c1c3b7-3354-411c-8602-f7ca5fb333c7 req-6ccd01ae-3366-46c7-92a0-ada4b870cd74 service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:25.848397 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-d5c1c3b7-3354-411c-8602-f7ca5fb333c7 req-6ccd01ae-3366-46c7-92a0-ada4b870cd74 service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:25.867448 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.compute.server_external_events [req-d5c1c3b7-3354-411c-8602-f7ca5fb333c7 req-6ccd01ae-3366-46c7-92a0-ada4b870cd74 service nova] Creating event network-vif-plugged:972d33d2-8e4d-4169-af65-29a82d02d383 for instance c405e3d0-6da8-4dac-9dc9-0c084024bb9f on hv-cinder-82497 Jan 28 02:12:25.873593 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [req-d5c1c3b7-3354-411c-8602-f7ca5fb333c7 req-6ccd01ae-3366-46c7-92a0-ada4b870cd74 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039553 Jan 28 02:12:25.877392 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 464/961] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Jan 28 02:12:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:12:26.247033 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-e5e76397-0203-48f4-aa7a-85bbfa378fc8 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:12:26.248271 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-e5e76397-0203-48f4-aa7a-85bbfa378fc8 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:26.254970 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-e5e76397-0203-48f4-aa7a-85bbfa378fc8 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:26.255512 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-e5e76397-0203-48f4-aa7a-85bbfa378fc8 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:26.256379 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-e5e76397-0203-48f4-aa7a-85bbfa378fc8 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:26.256877 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-e5e76397-0203-48f4-aa7a-85bbfa378fc8 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:26.364638 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-e5e76397-0203-48f4-aa7a-85bbfa378fc8 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "POST /compute/v2.1/servers/ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc/action" status: 200 len: 28652 microversion: 2.1 time: 0.121182 Jan 28 02:12:26.365641 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 498/962] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Jan 28 02:12:26 2022] POST /compute/v2.1/servers/ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc/action => generated 28652 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 02:12:26.537588 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-7c0ad4de-0cb3-4eb4-a824-059863ee981b tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:12:26.538267 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-7c0ad4de-0cb3-4eb4-a824-059863ee981b tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: c3ea23ca-a790-4f52-ad85-dcac640a8695] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:26.544681 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-7c0ad4de-0cb3-4eb4-a824-059863ee981b tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:26.545127 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-7c0ad4de-0cb3-4eb4-a824-059863ee981b tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:26.545926 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-7c0ad4de-0cb3-4eb4-a824-059863ee981b tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:26.546626 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-7c0ad4de-0cb3-4eb4-a824-059863ee981b tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:26.696564 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-7c0ad4de-0cb3-4eb4-a824-059863ee981b tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:26.706529 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-7c0ad4de-0cb3-4eb4-a824-059863ee981b tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:26.709683 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-7c0ad4de-0cb3-4eb4-a824-059863ee981b tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:26.711630 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-7c0ad4de-0cb3-4eb4-a824-059863ee981b tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695" status: 200 len: 1737 microversion: 2.20 time: 0.178204 Jan 28 02:12:26.724059 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 465/963] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:12:26 2022] GET /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695 => generated 1737 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:12:26.781225 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-a0d1a439-2cef-4e42-8e19-b497fd3cea35 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:12:26.782236 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-a0d1a439-2cef-4e42-8e19-b497fd3cea35 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] [instance: c405e3d0-6da8-4dac-9dc9-0c084024bb9f] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:26.790621 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-a0d1a439-2cef-4e42-8e19-b497fd3cea35 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:26.791313 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-a0d1a439-2cef-4e42-8e19-b497fd3cea35 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:26.792604 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-a0d1a439-2cef-4e42-8e19-b497fd3cea35 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:26.793401 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-a0d1a439-2cef-4e42-8e19-b497fd3cea35 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:26.925547 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-a0d1a439-2cef-4e42-8e19-b497fd3cea35 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cdbf7d369e4437eae7a36529d6cd623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed8db325d13496c9a417966e33b10a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:26.933177 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-a0d1a439-2cef-4e42-8e19-b497fd3cea35 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] 10.222.0.79 "GET /compute/v2.1/servers/c405e3d0-6da8-4dac-9dc9-0c084024bb9f" status: 200 len: 1265 microversion: 2.1 time: 0.156020 Jan 28 02:12:26.933858 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 499/964] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:12:26 2022] GET /compute/v2.1/servers/c405e3d0-6da8-4dac-9dc9-0c084024bb9f => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:12:27.377152 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-9ca45234-f155-4949-8a49-ad505aa54624 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:12:27.377973 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-9ca45234-f155-4949-8a49-ad505aa54624 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:27.384109 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-9ca45234-f155-4949-8a49-ad505aa54624 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:27.384578 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-9ca45234-f155-4949-8a49-ad505aa54624 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:27.385356 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-9ca45234-f155-4949-8a49-ad505aa54624 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:27.385865 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-9ca45234-f155-4949-8a49-ad505aa54624 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:27.536592 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-9ca45234-f155-4949-8a49-ad505aa54624 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "POST /compute/v2.1/servers/ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc/action" status: 200 len: 28771 microversion: 2.1 time: 0.163519 Jan 28 02:12:27.537556 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 466/965] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Jan 28 02:12:27 2022] POST /compute/v2.1/servers/ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc/action => generated 28771 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 02:12:27.730793 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-c909c7d8-b488-4611-b5d0-b418694935af tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:12:27.731417 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-c909c7d8-b488-4611-b5d0-b418694935af tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: c3ea23ca-a790-4f52-ad85-dcac640a8695] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:27.744123 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-c909c7d8-b488-4611-b5d0-b418694935af tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:27.744930 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-c909c7d8-b488-4611-b5d0-b418694935af tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:27.745922 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-c909c7d8-b488-4611-b5d0-b418694935af tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:27.746368 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-c909c7d8-b488-4611-b5d0-b418694935af tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:27.883646 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-c909c7d8-b488-4611-b5d0-b418694935af tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:27.894343 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-c909c7d8-b488-4611-b5d0-b418694935af tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:27.895832 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-c909c7d8-b488-4611-b5d0-b418694935af tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:27.897051 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-c909c7d8-b488-4611-b5d0-b418694935af tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695" status: 200 len: 1737 microversion: 2.20 time: 0.170176 Jan 28 02:12:27.897610 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 500/966] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:12:27 2022] GET /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695 => generated 1737 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:12:27.952707 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-c81e322d-de04-44c3-83f1-73ded88dd385 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:12:27.953614 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-c81e322d-de04-44c3-83f1-73ded88dd385 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] [instance: c405e3d0-6da8-4dac-9dc9-0c084024bb9f] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:27.961922 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c81e322d-de04-44c3-83f1-73ded88dd385 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:27.962460 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c81e322d-de04-44c3-83f1-73ded88dd385 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:27.963357 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c81e322d-de04-44c3-83f1-73ded88dd385 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:27.963864 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c81e322d-de04-44c3-83f1-73ded88dd385 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:28.096490 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-c81e322d-de04-44c3-83f1-73ded88dd385 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cdbf7d369e4437eae7a36529d6cd623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed8db325d13496c9a417966e33b10a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:28.103934 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-c81e322d-de04-44c3-83f1-73ded88dd385 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] 10.222.0.79 "GET /compute/v2.1/servers/c405e3d0-6da8-4dac-9dc9-0c084024bb9f" status: 200 len: 1451 microversion: 2.1 time: 0.156599 Jan 28 02:12:28.104542 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 467/967] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:12:27 2022] GET /compute/v2.1/servers/c405e3d0-6da8-4dac-9dc9-0c084024bb9f => generated 1451 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:12:28.120963 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-9d8f7973-a875-4e96-8b42-5f0c34fbaa33 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:12:28.121586 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-9d8f7973-a875-4e96-8b42-5f0c34fbaa33 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] [instance: c405e3d0-6da8-4dac-9dc9-0c084024bb9f] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:28.128343 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-9d8f7973-a875-4e96-8b42-5f0c34fbaa33 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:28.128859 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-9d8f7973-a875-4e96-8b42-5f0c34fbaa33 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:28.129639 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-9d8f7973-a875-4e96-8b42-5f0c34fbaa33 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:28.130082 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-9d8f7973-a875-4e96-8b42-5f0c34fbaa33 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:28.260100 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-9d8f7973-a875-4e96-8b42-5f0c34fbaa33 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cdbf7d369e4437eae7a36529d6cd623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed8db325d13496c9a417966e33b10a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:28.268048 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-9d8f7973-a875-4e96-8b42-5f0c34fbaa33 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] 10.222.0.79 "GET /compute/v2.1/servers/c405e3d0-6da8-4dac-9dc9-0c084024bb9f" status: 200 len: 1451 microversion: 2.1 time: 0.150983 Jan 28 02:12:28.268626 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 501/968] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:12:28 2022] GET /compute/v2.1/servers/c405e3d0-6da8-4dac-9dc9-0c084024bb9f => generated 1451 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:12:28.549631 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-0c2fa410-4a1b-4151-998a-d10460234ee0 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:12:28.550537 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-0c2fa410-4a1b-4151-998a-d10460234ee0 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:28.556481 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-0c2fa410-4a1b-4151-998a-d10460234ee0 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:28.556867 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-0c2fa410-4a1b-4151-998a-d10460234ee0 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:28.557624 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-0c2fa410-4a1b-4151-998a-d10460234ee0 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:28.558052 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-0c2fa410-4a1b-4151-998a-d10460234ee0 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:28.673073 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-0c2fa410-4a1b-4151-998a-d10460234ee0 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "POST /compute/v2.1/servers/ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc/action" status: 200 len: 30390 microversion: 2.1 time: 0.126729 Jan 28 02:12:28.677230 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 468/969] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Jan 28 02:12:28 2022] POST /compute/v2.1/servers/ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc/action => generated 30390 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 02:12:28.914619 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-e4ac7904-f4d4-4c0f-8360-55e4ed58b461 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:12:28.915382 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-e4ac7904-f4d4-4c0f-8360-55e4ed58b461 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: c3ea23ca-a790-4f52-ad85-dcac640a8695] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:28.921947 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-e4ac7904-f4d4-4c0f-8360-55e4ed58b461 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:28.922525 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-e4ac7904-f4d4-4c0f-8360-55e4ed58b461 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:28.923409 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-e4ac7904-f4d4-4c0f-8360-55e4ed58b461 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:28.923936 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-e4ac7904-f4d4-4c0f-8360-55e4ed58b461 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:29.092616 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-e4ac7904-f4d4-4c0f-8360-55e4ed58b461 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:29.102855 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-e4ac7904-f4d4-4c0f-8360-55e4ed58b461 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:29.104488 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-e4ac7904-f4d4-4c0f-8360-55e4ed58b461 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:29.105756 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-e4ac7904-f4d4-4c0f-8360-55e4ed58b461 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695" status: 200 len: 1737 microversion: 2.20 time: 0.194983 Jan 28 02:12:29.106466 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 502/970] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:12:28 2022] GET /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695 => generated 1737 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:12:29.685036 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-0964c7b1-2f0e-46f2-a27e-b3be1a2e79ba tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:12:29.686392 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-0964c7b1-2f0e-46f2-a27e-b3be1a2e79ba tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:29.693522 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-0964c7b1-2f0e-46f2-a27e-b3be1a2e79ba tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:29.700233 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-0964c7b1-2f0e-46f2-a27e-b3be1a2e79ba tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:29.700233 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-0964c7b1-2f0e-46f2-a27e-b3be1a2e79ba tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:29.700233 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-0964c7b1-2f0e-46f2-a27e-b3be1a2e79ba tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:29.799567 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-0964c7b1-2f0e-46f2-a27e-b3be1a2e79ba tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "POST /compute/v2.1/servers/ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc/action" status: 200 len: 32176 microversion: 2.1 time: 0.118570 Jan 28 02:12:29.800140 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 469/971] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Jan 28 02:12:29 2022] POST /compute/v2.1/servers/ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc/action => generated 32176 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 02:12:30.125635 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-2a9a131b-3c36-4bc9-bb8f-b67626ab199c tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:12:30.126592 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-2a9a131b-3c36-4bc9-bb8f-b67626ab199c tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: c3ea23ca-a790-4f52-ad85-dcac640a8695] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:30.133145 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-2a9a131b-3c36-4bc9-bb8f-b67626ab199c tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:30.133695 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-2a9a131b-3c36-4bc9-bb8f-b67626ab199c tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:30.135318 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-2a9a131b-3c36-4bc9-bb8f-b67626ab199c tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:30.135318 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-2a9a131b-3c36-4bc9-bb8f-b67626ab199c tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:30.354383 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-2a9a131b-3c36-4bc9-bb8f-b67626ab199c tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:30.362618 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-2a9a131b-3c36-4bc9-bb8f-b67626ab199c tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:30.364168 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-2a9a131b-3c36-4bc9-bb8f-b67626ab199c tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:30.365761 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-2a9a131b-3c36-4bc9-bb8f-b67626ab199c tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695" status: 200 len: 1737 microversion: 2.20 time: 0.244375 Jan 28 02:12:30.366719 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 503/972] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:12:30 2022] GET /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695 => generated 1737 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:12:30.654325 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [req-e6a3efe4-d8c1-45b8-9cd2-1bf7073166ca req-0a86f9ec-3ff0-49e9-9d83-25ffcdf3f38a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c405e3d0-6da8-4dac-9dc9-0c084024bb9f", "tag": "972d33d2-8e4d-4169-af65-29a82d02d383"}]} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:12:30.657252 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:12:30.657252 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: warnings.warn(msg) Jan 28 02:12:30.667522 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-e6a3efe4-d8c1-45b8-9cd2-1bf7073166ca req-0a86f9ec-3ff0-49e9-9d83-25ffcdf3f38a service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:30.668098 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-e6a3efe4-d8c1-45b8-9cd2-1bf7073166ca req-0a86f9ec-3ff0-49e9-9d83-25ffcdf3f38a service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:30.680191 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.compute.server_external_events [req-e6a3efe4-d8c1-45b8-9cd2-1bf7073166ca req-0a86f9ec-3ff0-49e9-9d83-25ffcdf3f38a service nova] Creating event network-changed:972d33d2-8e4d-4169-af65-29a82d02d383 for instance c405e3d0-6da8-4dac-9dc9-0c084024bb9f on hv-cinder-82497 Jan 28 02:12:30.685329 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [req-e6a3efe4-d8c1-45b8-9cd2-1bf7073166ca req-0a86f9ec-3ff0-49e9-9d83-25ffcdf3f38a service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036855 Jan 28 02:12:30.686810 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 470/973] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Jan 28 02:12:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:12:30.811018 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-dbea9f09-3bf3-4a70-8321-4092088b68f6 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:12:30.812719 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-dbea9f09-3bf3-4a70-8321-4092088b68f6 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:30.818963 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-dbea9f09-3bf3-4a70-8321-4092088b68f6 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:30.819424 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-dbea9f09-3bf3-4a70-8321-4092088b68f6 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:30.820237 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-dbea9f09-3bf3-4a70-8321-4092088b68f6 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:30.820689 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-dbea9f09-3bf3-4a70-8321-4092088b68f6 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:30.925531 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-dbea9f09-3bf3-4a70-8321-4092088b68f6 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "POST /compute/v2.1/servers/ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc/action" status: 200 len: 33333 microversion: 2.1 time: 0.118038 Jan 28 02:12:30.929750 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 504/974] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Jan 28 02:12:30 2022] POST /compute/v2.1/servers/ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc/action => generated 33333 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 02:12:31.386789 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-de01600b-47d8-4f5b-9744-9dfb96a1c431 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:12:31.388050 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-de01600b-47d8-4f5b-9744-9dfb96a1c431 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: c3ea23ca-a790-4f52-ad85-dcac640a8695] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:31.396955 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-de01600b-47d8-4f5b-9744-9dfb96a1c431 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:31.397843 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-de01600b-47d8-4f5b-9744-9dfb96a1c431 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:31.398885 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-de01600b-47d8-4f5b-9744-9dfb96a1c431 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:31.399408 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-de01600b-47d8-4f5b-9744-9dfb96a1c431 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:31.601084 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-de01600b-47d8-4f5b-9744-9dfb96a1c431 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:31.611237 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-de01600b-47d8-4f5b-9744-9dfb96a1c431 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:31.612926 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-de01600b-47d8-4f5b-9744-9dfb96a1c431 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:31.614120 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-de01600b-47d8-4f5b-9744-9dfb96a1c431 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695" status: 200 len: 1719 microversion: 2.20 time: 0.231946 Jan 28 02:12:31.614672 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 471/975] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:12:31 2022] GET /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695 => generated 1719 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:12:31.938834 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-6383ca2f-88c1-4456-98f9-3951413ee17f tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:12:31.939761 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-6383ca2f-88c1-4456-98f9-3951413ee17f tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:31.946288 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-6383ca2f-88c1-4456-98f9-3951413ee17f tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:31.946721 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-6383ca2f-88c1-4456-98f9-3951413ee17f tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:31.947477 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-6383ca2f-88c1-4456-98f9-3951413ee17f tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:31.947900 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-6383ca2f-88c1-4456-98f9-3951413ee17f tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:32.052491 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-6383ca2f-88c1-4456-98f9-3951413ee17f tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "POST /compute/v2.1/servers/ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc/action" status: 200 len: 34084 microversion: 2.1 time: 0.118264 Jan 28 02:12:32.053052 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 505/976] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Jan 28 02:12:31 2022] POST /compute/v2.1/servers/ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc/action => generated 34084 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 02:12:32.638860 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-50bb734b-35c8-4b2d-adcc-4db2c3723af3 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:12:32.639447 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-50bb734b-35c8-4b2d-adcc-4db2c3723af3 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: c3ea23ca-a790-4f52-ad85-dcac640a8695] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:32.646092 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-50bb734b-35c8-4b2d-adcc-4db2c3723af3 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:32.646533 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-50bb734b-35c8-4b2d-adcc-4db2c3723af3 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:32.647299 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-50bb734b-35c8-4b2d-adcc-4db2c3723af3 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:32.647730 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-50bb734b-35c8-4b2d-adcc-4db2c3723af3 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:32.768922 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-50bb734b-35c8-4b2d-adcc-4db2c3723af3 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:32.776585 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-50bb734b-35c8-4b2d-adcc-4db2c3723af3 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:32.778059 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-50bb734b-35c8-4b2d-adcc-4db2c3723af3 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:32.779197 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-50bb734b-35c8-4b2d-adcc-4db2c3723af3 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695" status: 200 len: 1719 microversion: 2.20 time: 0.144061 Jan 28 02:12:32.779752 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 472/977] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:12:32 2022] GET /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695 => generated 1719 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:12:33.064888 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-2632293c-02fe-4058-8e77-3f42092a854a tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:12:33.065795 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-2632293c-02fe-4058-8e77-3f42092a854a tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:33.072238 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-2632293c-02fe-4058-8e77-3f42092a854a tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:33.072676 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-2632293c-02fe-4058-8e77-3f42092a854a tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:33.073433 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-2632293c-02fe-4058-8e77-3f42092a854a tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:33.073859 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-2632293c-02fe-4058-8e77-3f42092a854a tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:33.197180 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-2632293c-02fe-4058-8e77-3f42092a854a tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "POST /compute/v2.1/servers/ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc/action" status: 200 len: 35053 microversion: 2.1 time: 0.136401 Jan 28 02:12:33.198097 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 506/978] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Jan 28 02:12:33 2022] POST /compute/v2.1/servers/ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc/action => generated 35053 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 02:12:33.547718 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [req-6b8ee248-9660-40e7-a76a-e3fd200d07f2 req-f0ebd2ac-3a09-4e10-a167-f8614a8abbe4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3ea23ca-a790-4f52-ad85-dcac640a8695", "name": "network-vif-unplugged", "status": "completed", "tag": "a5ba13e6-3134-4ccb-b060-70df55025709"}]} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:12:33.549871 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:12:33.549871 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: warnings.warn(msg) Jan 28 02:12:33.557029 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-6b8ee248-9660-40e7-a76a-e3fd200d07f2 req-f0ebd2ac-3a09-4e10-a167-f8614a8abbe4 service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:33.557475 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-6b8ee248-9660-40e7-a76a-e3fd200d07f2 req-f0ebd2ac-3a09-4e10-a167-f8614a8abbe4 service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:33.569427 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.compute.server_external_events [req-6b8ee248-9660-40e7-a76a-e3fd200d07f2 req-f0ebd2ac-3a09-4e10-a167-f8614a8abbe4 service nova] Creating event network-vif-unplugged:a5ba13e6-3134-4ccb-b060-70df55025709 for instance c3ea23ca-a790-4f52-ad85-dcac640a8695 on hv-cinder-82497 Jan 28 02:12:33.574428 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [req-6b8ee248-9660-40e7-a76a-e3fd200d07f2 req-f0ebd2ac-3a09-4e10-a167-f8614a8abbe4 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031438 Jan 28 02:12:33.575035 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 473/979] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Jan 28 02:12:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 02:12:33.799327 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-a10d869b-d773-413c-9b56-7ec3b4ee95bc tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:12:33.800032 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-a10d869b-d773-413c-9b56-7ec3b4ee95bc tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: c3ea23ca-a790-4f52-ad85-dcac640a8695] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:33.806416 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-a10d869b-d773-413c-9b56-7ec3b4ee95bc tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:33.806865 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-a10d869b-d773-413c-9b56-7ec3b4ee95bc tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:33.807628 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-a10d869b-d773-413c-9b56-7ec3b4ee95bc tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:33.808087 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-a10d869b-d773-413c-9b56-7ec3b4ee95bc tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:33.928872 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-a10d869b-d773-413c-9b56-7ec3b4ee95bc tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:33.936671 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-a10d869b-d773-413c-9b56-7ec3b4ee95bc tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:33.938175 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-a10d869b-d773-413c-9b56-7ec3b4ee95bc tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:33.939321 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-a10d869b-d773-413c-9b56-7ec3b4ee95bc tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695" status: 200 len: 1722 microversion: 2.20 time: 0.144892 Jan 28 02:12:33.939884 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 507/980] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:12:33 2022] GET /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695 => generated 1722 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:12:33.962519 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-b6627e71-d79c-4562-89d4-a532bd2800e9 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "11ca2981-2e5f-47c3-b9e3-2ed7e89c5d43"}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:12:33.963576 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-b6627e71-d79c-4562-89d4-a532bd2800e9 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: c3ea23ca-a790-4f52-ad85-dcac640a8695] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:33.970447 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b6627e71-d79c-4562-89d4-a532bd2800e9 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:33.970887 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b6627e71-d79c-4562-89d4-a532bd2800e9 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:33.971918 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b6627e71-d79c-4562-89d4-a532bd2800e9 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:33.972381 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b6627e71-d79c-4562-89d4-a532bd2800e9 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:34.210362 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-31507e25-0769-4ba6-b8e1-83668671e7ce tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:12:34.211273 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-31507e25-0769-4ba6-b8e1-83668671e7ce tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:34.217151 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-31507e25-0769-4ba6-b8e1-83668671e7ce tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:34.218192 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-31507e25-0769-4ba6-b8e1-83668671e7ce tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:34.219275 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-31507e25-0769-4ba6-b8e1-83668671e7ce tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:34.219700 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-31507e25-0769-4ba6-b8e1-83668671e7ce tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:34.325156 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-31507e25-0769-4ba6-b8e1-83668671e7ce tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "POST /compute/v2.1/servers/ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc/action" status: 200 len: 36187 microversion: 2.1 time: 0.118350 Jan 28 02:12:34.325831 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 508/981] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Jan 28 02:12:34 2022] POST /compute/v2.1/servers/ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc/action => generated 36187 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 02:12:34.997044 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-b6627e71-d79c-4562-89d4-a532bd2800e9 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "POST /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.038694 Jan 28 02:12:34.997660 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 474/982] 10.222.0.79 () {62 vars in 1363 bytes} [Fri Jan 28 02:12:33 2022] POST /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695/os-volume_attachments => generated 188 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 02:12:35.117414 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-c6c0d23b-3f50-4f1a-8b50-db8d924a7f8d tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:12:35.117988 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-c6c0d23b-3f50-4f1a-8b50-db8d924a7f8d tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: c3ea23ca-a790-4f52-ad85-dcac640a8695] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:35.124485 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-c6c0d23b-3f50-4f1a-8b50-db8d924a7f8d tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:35.124934 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-c6c0d23b-3f50-4f1a-8b50-db8d924a7f8d tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:35.125703 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-c6c0d23b-3f50-4f1a-8b50-db8d924a7f8d tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:35.126137 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-c6c0d23b-3f50-4f1a-8b50-db8d924a7f8d tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:35.337713 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-3556790b-50d4-44ec-a3d9-540005f1f5eb tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:12:35.338581 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-3556790b-50d4-44ec-a3d9-540005f1f5eb tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:35.345142 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-3556790b-50d4-44ec-a3d9-540005f1f5eb tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:35.345641 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-3556790b-50d4-44ec-a3d9-540005f1f5eb tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:35.346746 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-3556790b-50d4-44ec-a3d9-540005f1f5eb tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:35.347282 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-3556790b-50d4-44ec-a3d9-540005f1f5eb tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:35.445375 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-3556790b-50d4-44ec-a3d9-540005f1f5eb tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "POST /compute/v2.1/servers/ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc/action" status: 200 len: 37785 microversion: 2.1 time: 0.111347 Jan 28 02:12:35.446024 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 475/983] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Jan 28 02:12:35 2022] POST /compute/v2.1/servers/ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc/action => generated 37785 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 02:12:35.826644 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-c6c0d23b-3f50-4f1a-8b50-db8d924a7f8d tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "DELETE /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695/os-volume_attachments/11ca2981-2e5f-47c3-b9e3-2ed7e89c5d43" status: 202 len: 0 microversion: 2.20 time: 0.713286 Jan 28 02:12:35.827247 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 509/984] 10.222.0.79 () {60 vars in 1456 bytes} [Fri Jan 28 02:12:35 2022] DELETE /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695/os-volume_attachments/11ca2981-2e5f-47c3-b9e3-2ed7e89c5d43 => generated 0 bytes in 715 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 28 02:12:35.886837 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-ea13923c-b8eb-468e-8e69-74a26be3a3f2 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:12:35.887486 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-ea13923c-b8eb-468e-8e69-74a26be3a3f2 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: c3ea23ca-a790-4f52-ad85-dcac640a8695] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:35.893857 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ea13923c-b8eb-468e-8e69-74a26be3a3f2 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:35.894300 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ea13923c-b8eb-468e-8e69-74a26be3a3f2 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:35.895064 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ea13923c-b8eb-468e-8e69-74a26be3a3f2 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:35.895495 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ea13923c-b8eb-468e-8e69-74a26be3a3f2 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:36.080714 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-ea13923c-b8eb-468e-8e69-74a26be3a3f2 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "POST /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695/action" status: 202 len: 0 microversion: 2.20 time: 0.197765 Jan 28 02:12:36.081351 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 476/985] 10.222.0.79 () {62 vars in 1318 bytes} [Fri Jan 28 02:12:35 2022] POST /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695/action => generated 0 bytes in 199 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 28 02:12:36.089347 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-e04c61de-d5b2-4e98-83aa-aa7985280652 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:12:36.089951 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-e04c61de-d5b2-4e98-83aa-aa7985280652 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: c3ea23ca-a790-4f52-ad85-dcac640a8695] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:36.096842 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-e04c61de-d5b2-4e98-83aa-aa7985280652 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:36.097376 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-e04c61de-d5b2-4e98-83aa-aa7985280652 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:36.098145 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-e04c61de-d5b2-4e98-83aa-aa7985280652 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:36.098700 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-e04c61de-d5b2-4e98-83aa-aa7985280652 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:36.227864 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-e04c61de-d5b2-4e98-83aa-aa7985280652 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:36.235789 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-e04c61de-d5b2-4e98-83aa-aa7985280652 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:36.238248 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-e04c61de-d5b2-4e98-83aa-aa7985280652 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:36.239406 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-e04c61de-d5b2-4e98-83aa-aa7985280652 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695" status: 200 len: 1670 microversion: 2.20 time: 0.153822 Jan 28 02:12:36.239959 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 510/986] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:12:36 2022] GET /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695 => generated 1670 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:12:36.458226 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-f65842a0-8673-417a-bf3a-675fd7337735 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:12:36.459170 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-f65842a0-8673-417a-bf3a-675fd7337735 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:36.465004 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f65842a0-8673-417a-bf3a-675fd7337735 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:36.465447 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f65842a0-8673-417a-bf3a-675fd7337735 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:36.466208 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f65842a0-8673-417a-bf3a-675fd7337735 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:36.466637 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f65842a0-8673-417a-bf3a-675fd7337735 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:36.570006 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-f65842a0-8673-417a-bf3a-675fd7337735 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "POST /compute/v2.1/servers/ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc/action" status: 200 len: 38184 microversion: 2.1 time: 0.116242 Jan 28 02:12:36.570762 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 477/987] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Jan 28 02:12:36 2022] POST /compute/v2.1/servers/ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc/action => generated 38184 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 02:12:37.258097 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-bbffedb0-59e9-4631-aa13-b4e50717b691 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:12:37.258697 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-bbffedb0-59e9-4631-aa13-b4e50717b691 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: c3ea23ca-a790-4f52-ad85-dcac640a8695] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:37.264583 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-bbffedb0-59e9-4631-aa13-b4e50717b691 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:37.265019 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-bbffedb0-59e9-4631-aa13-b4e50717b691 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:37.265776 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-bbffedb0-59e9-4631-aa13-b4e50717b691 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:37.266202 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-bbffedb0-59e9-4631-aa13-b4e50717b691 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:37.384706 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-bbffedb0-59e9-4631-aa13-b4e50717b691 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:37.392217 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-bbffedb0-59e9-4631-aa13-b4e50717b691 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:37.393790 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-bbffedb0-59e9-4631-aa13-b4e50717b691 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:37.394974 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-bbffedb0-59e9-4631-aa13-b4e50717b691 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695" status: 200 len: 1672 microversion: 2.20 time: 0.140594 Jan 28 02:12:37.395472 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 511/988] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:12:37 2022] GET /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695 => generated 1672 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:12:37.582494 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-60aa3ac2-afef-461b-ad58-309e8d1edbe5 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:12:37.583612 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-60aa3ac2-afef-461b-ad58-309e8d1edbe5 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:37.590120 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-60aa3ac2-afef-461b-ad58-309e8d1edbe5 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:37.590568 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-60aa3ac2-afef-461b-ad58-309e8d1edbe5 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:37.591327 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-60aa3ac2-afef-461b-ad58-309e8d1edbe5 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:37.591764 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-60aa3ac2-afef-461b-ad58-309e8d1edbe5 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:37.680037 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-60aa3ac2-afef-461b-ad58-309e8d1edbe5 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "POST /compute/v2.1/servers/ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc/action" status: 200 len: 38184 microversion: 2.1 time: 0.101687 Jan 28 02:12:37.680683 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 478/989] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Jan 28 02:12:37 2022] POST /compute/v2.1/servers/ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc/action => generated 38184 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 02:12:38.414385 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-155b4937-9f78-4cb4-8824-4b764e2ffb08 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:12:38.415030 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-155b4937-9f78-4cb4-8824-4b764e2ffb08 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: c3ea23ca-a790-4f52-ad85-dcac640a8695] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:38.421460 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-155b4937-9f78-4cb4-8824-4b764e2ffb08 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:38.425193 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-155b4937-9f78-4cb4-8824-4b764e2ffb08 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:38.425193 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-155b4937-9f78-4cb4-8824-4b764e2ffb08 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:38.425193 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-155b4937-9f78-4cb4-8824-4b764e2ffb08 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:38.608347 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-155b4937-9f78-4cb4-8824-4b764e2ffb08 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:38.616657 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-155b4937-9f78-4cb4-8824-4b764e2ffb08 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:38.618134 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-155b4937-9f78-4cb4-8824-4b764e2ffb08 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:38.619278 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-155b4937-9f78-4cb4-8824-4b764e2ffb08 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695" status: 200 len: 1728 microversion: 2.20 time: 0.208848 Jan 28 02:12:38.619846 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 512/990] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:12:38 2022] GET /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695 => generated 1728 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:12:38.693137 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-6617bbbf-3e91-4beb-88fa-e20f020c8db9 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:12:38.694122 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-6617bbbf-3e91-4beb-88fa-e20f020c8db9 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:38.700450 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-6617bbbf-3e91-4beb-88fa-e20f020c8db9 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:38.700889 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-6617bbbf-3e91-4beb-88fa-e20f020c8db9 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:38.701681 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-6617bbbf-3e91-4beb-88fa-e20f020c8db9 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:38.702104 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-6617bbbf-3e91-4beb-88fa-e20f020c8db9 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:38.802659 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-6617bbbf-3e91-4beb-88fa-e20f020c8db9 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "POST /compute/v2.1/servers/ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc/action" status: 200 len: 38184 microversion: 2.1 time: 0.114107 Jan 28 02:12:38.803632 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 479/991] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Jan 28 02:12:38 2022] POST /compute/v2.1/servers/ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc/action => generated 38184 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 02:12:39.640077 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-a33b2d77-2464-49b3-aae7-584db743437e tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:12:39.641982 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-a33b2d77-2464-49b3-aae7-584db743437e tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: c3ea23ca-a790-4f52-ad85-dcac640a8695] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:39.648846 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-a33b2d77-2464-49b3-aae7-584db743437e tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:39.649596 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-a33b2d77-2464-49b3-aae7-584db743437e tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:39.650502 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-a33b2d77-2464-49b3-aae7-584db743437e tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:39.651064 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-a33b2d77-2464-49b3-aae7-584db743437e tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:39.782407 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-a33b2d77-2464-49b3-aae7-584db743437e tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:39.791295 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-a33b2d77-2464-49b3-aae7-584db743437e tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:39.793105 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-a33b2d77-2464-49b3-aae7-584db743437e tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:39.794302 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-a33b2d77-2464-49b3-aae7-584db743437e tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695" status: 200 len: 1728 microversion: 2.20 time: 0.159652 Jan 28 02:12:39.794872 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 513/992] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:12:39 2022] GET /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695 => generated 1728 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:12:39.815875 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-d78f8b40-baf3-4d4b-8364-2853dd30960e tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:12:39.816902 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-d78f8b40-baf3-4d4b-8364-2853dd30960e tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:39.823997 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-d78f8b40-baf3-4d4b-8364-2853dd30960e tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:39.824435 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-d78f8b40-baf3-4d4b-8364-2853dd30960e tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:39.825213 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-d78f8b40-baf3-4d4b-8364-2853dd30960e tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:39.825638 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-d78f8b40-baf3-4d4b-8364-2853dd30960e tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:40.814220 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-02722a0e-49f1-421c-bda4-e48e9a3354c9 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:12:40.816785 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-02722a0e-49f1-421c-bda4-e48e9a3354c9 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: c3ea23ca-a790-4f52-ad85-dcac640a8695] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:40.827417 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-02722a0e-49f1-421c-bda4-e48e9a3354c9 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:40.828335 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-02722a0e-49f1-421c-bda4-e48e9a3354c9 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:40.829117 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-02722a0e-49f1-421c-bda4-e48e9a3354c9 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:40.829548 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-02722a0e-49f1-421c-bda4-e48e9a3354c9 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:40.982984 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-02722a0e-49f1-421c-bda4-e48e9a3354c9 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:40.991946 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-02722a0e-49f1-421c-bda4-e48e9a3354c9 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:40.993543 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-02722a0e-49f1-421c-bda4-e48e9a3354c9 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:40.994703 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-02722a0e-49f1-421c-bda4-e48e9a3354c9 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695" status: 200 len: 1728 microversion: 2.20 time: 0.185692 Jan 28 02:12:40.995267 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 514/993] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:12:40 2022] GET /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695 => generated 1728 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:12:42.012673 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-ed04161b-74fa-4445-99b5-d65dced5218f tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:12:42.013370 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-ed04161b-74fa-4445-99b5-d65dced5218f tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: c3ea23ca-a790-4f52-ad85-dcac640a8695] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:42.019759 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-ed04161b-74fa-4445-99b5-d65dced5218f tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:42.020222 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-ed04161b-74fa-4445-99b5-d65dced5218f tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:42.020982 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-ed04161b-74fa-4445-99b5-d65dced5218f tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:42.021404 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-ed04161b-74fa-4445-99b5-d65dced5218f tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:42.150401 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-ed04161b-74fa-4445-99b5-d65dced5218f tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:42.164133 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-ed04161b-74fa-4445-99b5-d65dced5218f tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:42.165617 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-ed04161b-74fa-4445-99b5-d65dced5218f tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:42.166782 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-ed04161b-74fa-4445-99b5-d65dced5218f tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695" status: 200 len: 1728 microversion: 2.20 time: 0.157876 Jan 28 02:12:42.167341 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 515/994] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:12:42 2022] GET /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695 => generated 1728 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 02:12:43.185214 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-728a843d-3acf-4f11-86a1-c3582a14050c tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:12:43.185847 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-728a843d-3acf-4f11-86a1-c3582a14050c tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: c3ea23ca-a790-4f52-ad85-dcac640a8695] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:43.192720 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-728a843d-3acf-4f11-86a1-c3582a14050c tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:43.193436 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-728a843d-3acf-4f11-86a1-c3582a14050c tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:43.194399 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-728a843d-3acf-4f11-86a1-c3582a14050c tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:43.195010 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-728a843d-3acf-4f11-86a1-c3582a14050c tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:43.320912 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-728a843d-3acf-4f11-86a1-c3582a14050c tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:43.328976 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-728a843d-3acf-4f11-86a1-c3582a14050c tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:43.330152 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-728a843d-3acf-4f11-86a1-c3582a14050c tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:43.331304 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-728a843d-3acf-4f11-86a1-c3582a14050c tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695" status: 200 len: 1728 microversion: 2.20 time: 0.149846 Jan 28 02:12:43.332395 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 516/995] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:12:43 2022] GET /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695 => generated 1728 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 02:12:44.352799 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-7e786ef0-f9ac-42b2-883c-3d2a3be6af6f tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:12:44.353473 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-7e786ef0-f9ac-42b2-883c-3d2a3be6af6f tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: c3ea23ca-a790-4f52-ad85-dcac640a8695] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:44.359490 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-7e786ef0-f9ac-42b2-883c-3d2a3be6af6f tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:44.359932 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-7e786ef0-f9ac-42b2-883c-3d2a3be6af6f tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:44.360742 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-7e786ef0-f9ac-42b2-883c-3d2a3be6af6f tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:44.361172 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-7e786ef0-f9ac-42b2-883c-3d2a3be6af6f tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:44.489596 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-7e786ef0-f9ac-42b2-883c-3d2a3be6af6f tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:44.497641 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-7e786ef0-f9ac-42b2-883c-3d2a3be6af6f tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:44.499087 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-7e786ef0-f9ac-42b2-883c-3d2a3be6af6f tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:44.500273 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-7e786ef0-f9ac-42b2-883c-3d2a3be6af6f tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695" status: 200 len: 1728 microversion: 2.20 time: 0.153732 Jan 28 02:12:44.501141 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 517/996] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:12:44 2022] GET /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695 => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 02:12:45.061478 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-b7aac7ed-baf7-4262-84f0-e21caa0643ee tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:12:45.062000 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-b7aac7ed-baf7-4262-84f0-e21caa0643ee tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] [instance: 9b886ef6-6c08-4ed8-9d10-35c49c2c6382] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:45.068944 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-b7aac7ed-baf7-4262-84f0-e21caa0643ee tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:45.069385 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-b7aac7ed-baf7-4262-84f0-e21caa0643ee tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:45.070155 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-b7aac7ed-baf7-4262-84f0-e21caa0643ee tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:45.070578 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-b7aac7ed-baf7-4262-84f0-e21caa0643ee tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:45.094471 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.objects.instance [None req-b7aac7ed-baf7-4262-84f0-e21caa0643ee tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lazy-loading 'flavor' on Instance uuid 9b886ef6-6c08-4ed8-9d10-35c49c2c6382 {{(pid=116374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jan 28 02:12:45.431949 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-b7aac7ed-baf7-4262-84f0-e21caa0643ee tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] 10.222.0.79 "POST /compute/v2.1/servers/9b886ef6-6c08-4ed8-9d10-35c49c2c6382/action" status: 202 len: 0 microversion: 2.1 time: 0.374015 Jan 28 02:12:45.438361 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 518/997] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Jan 28 02:12:45 2022] POST /compute/v2.1/servers/9b886ef6-6c08-4ed8-9d10-35c49c2c6382/action => generated 0 bytes in 376 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 28 02:12:45.441466 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-461cf38b-8296-4832-b810-6992e49acc44 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:12:45.442529 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-461cf38b-8296-4832-b810-6992e49acc44 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] [instance: 9b886ef6-6c08-4ed8-9d10-35c49c2c6382] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:45.448684 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-461cf38b-8296-4832-b810-6992e49acc44 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:45.449130 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-461cf38b-8296-4832-b810-6992e49acc44 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:45.449902 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-461cf38b-8296-4832-b810-6992e49acc44 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:45.450450 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-461cf38b-8296-4832-b810-6992e49acc44 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:45.583607 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-461cf38b-8296-4832-b810-6992e49acc44 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5c39b83f31473696c9b249ab49d780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55dde8892fa47bd9941bb1ce9aa3673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:45.591159 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-461cf38b-8296-4832-b810-6992e49acc44 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] 10.222.0.79 "GET /compute/v2.1/servers/9b886ef6-6c08-4ed8-9d10-35c49c2c6382" status: 200 len: 1568 microversion: 2.1 time: 0.153713 Jan 28 02:12:45.591901 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 519/998] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:12:45 2022] GET /compute/v2.1/servers/9b886ef6-6c08-4ed8-9d10-35c49c2c6382 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:12:45.596010 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-4edd301b-23e3-4291-abae-71e2768e3866 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:12:45.596846 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-4edd301b-23e3-4291-abae-71e2768e3866 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: c3ea23ca-a790-4f52-ad85-dcac640a8695] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:45.603543 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-4edd301b-23e3-4291-abae-71e2768e3866 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:45.604023 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-4edd301b-23e3-4291-abae-71e2768e3866 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:45.604799 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-4edd301b-23e3-4291-abae-71e2768e3866 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:45.605552 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-4edd301b-23e3-4291-abae-71e2768e3866 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:45.731921 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-4edd301b-23e3-4291-abae-71e2768e3866 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:45.739847 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-4edd301b-23e3-4291-abae-71e2768e3866 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:45.741366 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-4edd301b-23e3-4291-abae-71e2768e3866 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:45.742518 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-4edd301b-23e3-4291-abae-71e2768e3866 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695" status: 200 len: 1728 microversion: 2.20 time: 0.149850 Jan 28 02:12:45.743277 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 520/999] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:12:45 2022] GET /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695 => generated 1728 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:12:46.610470 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-dce313bc-ca33-4bda-81f4-40045b2595cb tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:12:46.611955 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-dce313bc-ca33-4bda-81f4-40045b2595cb tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] [instance: 9b886ef6-6c08-4ed8-9d10-35c49c2c6382] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:46.618681 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-dce313bc-ca33-4bda-81f4-40045b2595cb tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:46.619334 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-dce313bc-ca33-4bda-81f4-40045b2595cb tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:46.620288 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-dce313bc-ca33-4bda-81f4-40045b2595cb tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:46.620901 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-dce313bc-ca33-4bda-81f4-40045b2595cb tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:46.771731 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-dce313bc-ca33-4bda-81f4-40045b2595cb tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5c39b83f31473696c9b249ab49d780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55dde8892fa47bd9941bb1ce9aa3673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:46.779538 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-dce313bc-ca33-4bda-81f4-40045b2595cb tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] 10.222.0.79 "GET /compute/v2.1/servers/9b886ef6-6c08-4ed8-9d10-35c49c2c6382" status: 200 len: 1568 microversion: 2.1 time: 0.172901 Jan 28 02:12:46.780339 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 521/1000] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:12:46 2022] GET /compute/v2.1/servers/9b886ef6-6c08-4ed8-9d10-35c49c2c6382 => generated 1568 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:12:46.791016 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-ccf84ca6-04a9-445e-a0d1-9c860f5025cb tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:12:46.791620 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-ccf84ca6-04a9-445e-a0d1-9c860f5025cb tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: c3ea23ca-a790-4f52-ad85-dcac640a8695] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:46.798450 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-ccf84ca6-04a9-445e-a0d1-9c860f5025cb tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:46.799160 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-ccf84ca6-04a9-445e-a0d1-9c860f5025cb tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:46.800067 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-ccf84ca6-04a9-445e-a0d1-9c860f5025cb tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:46.800693 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-ccf84ca6-04a9-445e-a0d1-9c860f5025cb tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:46.941141 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-ccf84ca6-04a9-445e-a0d1-9c860f5025cb tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:46.950857 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-ccf84ca6-04a9-445e-a0d1-9c860f5025cb tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:46.953317 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-ccf84ca6-04a9-445e-a0d1-9c860f5025cb tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:46.954755 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-ccf84ca6-04a9-445e-a0d1-9c860f5025cb tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695" status: 200 len: 1728 microversion: 2.20 time: 0.167355 Jan 28 02:12:46.956054 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 522/1001] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:12:46 2022] GET /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695 => generated 1728 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:12:47.796766 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-e203b862-736f-4f41-b867-bf3cf32e15f5 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:12:47.797465 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-e203b862-736f-4f41-b867-bf3cf32e15f5 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] [instance: 9b886ef6-6c08-4ed8-9d10-35c49c2c6382] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:47.803509 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-e203b862-736f-4f41-b867-bf3cf32e15f5 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:47.803956 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-e203b862-736f-4f41-b867-bf3cf32e15f5 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:47.804762 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-e203b862-736f-4f41-b867-bf3cf32e15f5 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:47.805264 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-e203b862-736f-4f41-b867-bf3cf32e15f5 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:47.928576 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-e203b862-736f-4f41-b867-bf3cf32e15f5 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5c39b83f31473696c9b249ab49d780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55dde8892fa47bd9941bb1ce9aa3673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:47.935791 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-e203b862-736f-4f41-b867-bf3cf32e15f5 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] 10.222.0.79 "GET /compute/v2.1/servers/9b886ef6-6c08-4ed8-9d10-35c49c2c6382" status: 200 len: 1568 microversion: 2.1 time: 0.142701 Jan 28 02:12:47.936376 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 523/1002] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:12:47 2022] GET /compute/v2.1/servers/9b886ef6-6c08-4ed8-9d10-35c49c2c6382 => generated 1568 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:12:47.974497 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-dbc72b45-9e48-4a01-b746-c1943a51775a tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:12:47.975001 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-dbc72b45-9e48-4a01-b746-c1943a51775a tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: c3ea23ca-a790-4f52-ad85-dcac640a8695] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:47.980607 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-dbc72b45-9e48-4a01-b746-c1943a51775a tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:47.981050 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-dbc72b45-9e48-4a01-b746-c1943a51775a tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:47.981809 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-dbc72b45-9e48-4a01-b746-c1943a51775a tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:47.982234 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-dbc72b45-9e48-4a01-b746-c1943a51775a tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:48.100358 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-dbc72b45-9e48-4a01-b746-c1943a51775a tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:48.107846 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-dbc72b45-9e48-4a01-b746-c1943a51775a tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:48.109349 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-dbc72b45-9e48-4a01-b746-c1943a51775a tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:48.110479 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-dbc72b45-9e48-4a01-b746-c1943a51775a tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695" status: 200 len: 1728 microversion: 2.20 time: 0.140872 Jan 28 02:12:48.111028 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 524/1003] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:12:47 2022] GET /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695 => generated 1728 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 02:12:48.425021 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-d78f8b40-baf3-4d4b-8364-2853dd30960e tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "POST /compute/v2.1/servers/ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc/action" status: 200 len: 38315 microversion: 2.1 time: 8.613596 Jan 28 02:12:48.429335 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 480/1004] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Jan 28 02:12:39 2022] POST /compute/v2.1/servers/ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc/action => generated 38315 bytes in 8615 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 02:12:48.435613 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-20f91346-2782-4749-80ea-69949d966625 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:12:48.436228 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-20f91346-2782-4749-80ea-69949d966625 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:48.442075 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-20f91346-2782-4749-80ea-69949d966625 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:48.442536 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-20f91346-2782-4749-80ea-69949d966625 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:48.443280 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-20f91346-2782-4749-80ea-69949d966625 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:48.443724 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-20f91346-2782-4749-80ea-69949d966625 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:48.467192 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-20f91346-2782-4749-80ea-69949d966625 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "GET /compute/v2.1/servers/ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc/ips" status: 200 len: 145 microversion: 2.1 time: 0.035198 Jan 28 02:12:48.467745 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 525/1005] 10.222.0.79 () {58 vars in 1247 bytes} [Fri Jan 28 02:12:48 2022] GET /compute/v2.1/servers/ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc/ips => generated 145 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:12:48.953947 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-884e28ba-4356-4b3a-99e3-437671ebe1b3 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:12:48.954681 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-884e28ba-4356-4b3a-99e3-437671ebe1b3 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] [instance: 9b886ef6-6c08-4ed8-9d10-35c49c2c6382] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:48.961990 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-884e28ba-4356-4b3a-99e3-437671ebe1b3 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:48.962434 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-884e28ba-4356-4b3a-99e3-437671ebe1b3 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:48.963300 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-884e28ba-4356-4b3a-99e3-437671ebe1b3 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:48.963728 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-884e28ba-4356-4b3a-99e3-437671ebe1b3 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:49.089481 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-884e28ba-4356-4b3a-99e3-437671ebe1b3 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5c39b83f31473696c9b249ab49d780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55dde8892fa47bd9941bb1ce9aa3673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:49.099131 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-884e28ba-4356-4b3a-99e3-437671ebe1b3 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] 10.222.0.79 "GET /compute/v2.1/servers/9b886ef6-6c08-4ed8-9d10-35c49c2c6382" status: 200 len: 1568 microversion: 2.1 time: 0.149387 Jan 28 02:12:49.099678 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 481/1006] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:12:48 2022] GET /compute/v2.1/servers/9b886ef6-6c08-4ed8-9d10-35c49c2c6382 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:12:49.129801 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-df529962-3125-45c0-bbdb-9af09025ef91 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:12:49.130520 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-df529962-3125-45c0-bbdb-9af09025ef91 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: c3ea23ca-a790-4f52-ad85-dcac640a8695] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:49.136415 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-df529962-3125-45c0-bbdb-9af09025ef91 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:49.136851 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-df529962-3125-45c0-bbdb-9af09025ef91 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:49.137636 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-df529962-3125-45c0-bbdb-9af09025ef91 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:49.138058 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-df529962-3125-45c0-bbdb-9af09025ef91 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:49.258662 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-df529962-3125-45c0-bbdb-9af09025ef91 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:49.266277 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-df529962-3125-45c0-bbdb-9af09025ef91 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:49.267752 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-df529962-3125-45c0-bbdb-9af09025ef91 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:49.268912 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-df529962-3125-45c0-bbdb-9af09025ef91 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695" status: 200 len: 1728 microversion: 2.20 time: 0.143562 Jan 28 02:12:49.269704 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 526/1007] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:12:49 2022] GET /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695 => generated 1728 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:12:50.048761 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-725e01b0-dae0-4285-abf5-666c1fcb2d9b tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a604cf08-46b7-442e-a64e-a848da92be40"}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:12:50.049481 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-725e01b0-dae0-4285-abf5-666c1fcb2d9b tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:50.056518 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-725e01b0-dae0-4285-abf5-666c1fcb2d9b tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:50.056959 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-725e01b0-dae0-4285-abf5-666c1fcb2d9b tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:50.057752 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-725e01b0-dae0-4285-abf5-666c1fcb2d9b tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:50.058185 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-725e01b0-dae0-4285-abf5-666c1fcb2d9b tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:50.116549 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-00f5c99a-ae4e-498a-849f-e24174d084e4 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:12:50.117144 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-00f5c99a-ae4e-498a-849f-e24174d084e4 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] [instance: 9b886ef6-6c08-4ed8-9d10-35c49c2c6382] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:50.122970 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-00f5c99a-ae4e-498a-849f-e24174d084e4 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:50.123421 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-00f5c99a-ae4e-498a-849f-e24174d084e4 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:50.124233 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-00f5c99a-ae4e-498a-849f-e24174d084e4 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:50.124670 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-00f5c99a-ae4e-498a-849f-e24174d084e4 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:50.250445 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-00f5c99a-ae4e-498a-849f-e24174d084e4 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5c39b83f31473696c9b249ab49d780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55dde8892fa47bd9941bb1ce9aa3673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:50.258122 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-00f5c99a-ae4e-498a-849f-e24174d084e4 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] 10.222.0.79 "GET /compute/v2.1/servers/9b886ef6-6c08-4ed8-9d10-35c49c2c6382" status: 200 len: 1568 microversion: 2.1 time: 0.146035 Jan 28 02:12:50.258692 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 527/1008] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:12:50 2022] GET /compute/v2.1/servers/9b886ef6-6c08-4ed8-9d10-35c49c2c6382 => generated 1568 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:12:50.288635 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-4963abd9-4e6b-4e35-97f1-f620528eb724 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:12:50.289205 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-4963abd9-4e6b-4e35-97f1-f620528eb724 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: c3ea23ca-a790-4f52-ad85-dcac640a8695] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:50.295003 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-4963abd9-4e6b-4e35-97f1-f620528eb724 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:50.295445 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-4963abd9-4e6b-4e35-97f1-f620528eb724 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:50.296237 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-4963abd9-4e6b-4e35-97f1-f620528eb724 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:50.296933 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-4963abd9-4e6b-4e35-97f1-f620528eb724 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:50.429650 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-4963abd9-4e6b-4e35-97f1-f620528eb724 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:50.437554 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-4963abd9-4e6b-4e35-97f1-f620528eb724 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:50.438661 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-4963abd9-4e6b-4e35-97f1-f620528eb724 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:50.439793 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-4963abd9-4e6b-4e35-97f1-f620528eb724 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695" status: 200 len: 1728 microversion: 2.20 time: 0.155513 Jan 28 02:12:50.440370 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 528/1009] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:12:50 2022] GET /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695 => generated 1728 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 02:12:50.905193 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-725e01b0-dae0-4285-abf5-666c1fcb2d9b tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "POST /compute/v2.1/servers/ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.860420 Jan 28 02:12:50.905797 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 482/1010] 10.222.0.79 () {60 vars in 1322 bytes} [Fri Jan 28 02:12:50 2022] POST /compute/v2.1/servers/ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc/os-volume_attachments => generated 194 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:12:51.275783 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-e1d06825-3e6e-4772-8af2-bb1f25b5845b tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:12:51.276344 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-e1d06825-3e6e-4772-8af2-bb1f25b5845b tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] [instance: 9b886ef6-6c08-4ed8-9d10-35c49c2c6382] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:51.283387 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-e1d06825-3e6e-4772-8af2-bb1f25b5845b tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:51.283818 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-e1d06825-3e6e-4772-8af2-bb1f25b5845b tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:51.284615 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-e1d06825-3e6e-4772-8af2-bb1f25b5845b tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:51.285250 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-e1d06825-3e6e-4772-8af2-bb1f25b5845b tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:51.404529 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-e1d06825-3e6e-4772-8af2-bb1f25b5845b tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5c39b83f31473696c9b249ab49d780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55dde8892fa47bd9941bb1ce9aa3673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:51.412215 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-e1d06825-3e6e-4772-8af2-bb1f25b5845b tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] 10.222.0.79 "GET /compute/v2.1/servers/9b886ef6-6c08-4ed8-9d10-35c49c2c6382" status: 200 len: 1568 microversion: 2.1 time: 0.140100 Jan 28 02:12:51.412778 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 529/1011] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:12:51 2022] GET /compute/v2.1/servers/9b886ef6-6c08-4ed8-9d10-35c49c2c6382 => generated 1568 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:12:51.459509 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-7d5df85e-cfc4-4f00-be13-c2e98abbad33 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:12:51.460219 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-7d5df85e-cfc4-4f00-be13-c2e98abbad33 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: c3ea23ca-a790-4f52-ad85-dcac640a8695] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:51.467125 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-7d5df85e-cfc4-4f00-be13-c2e98abbad33 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:51.467569 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-7d5df85e-cfc4-4f00-be13-c2e98abbad33 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:51.468357 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-7d5df85e-cfc4-4f00-be13-c2e98abbad33 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:51.468787 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-7d5df85e-cfc4-4f00-be13-c2e98abbad33 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:51.592418 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-7d5df85e-cfc4-4f00-be13-c2e98abbad33 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:51.600678 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-7d5df85e-cfc4-4f00-be13-c2e98abbad33 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:51.602174 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-7d5df85e-cfc4-4f00-be13-c2e98abbad33 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:51.603341 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-7d5df85e-cfc4-4f00-be13-c2e98abbad33 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695" status: 200 len: 1728 microversion: 2.20 time: 0.148746 Jan 28 02:12:51.603902 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 483/1012] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:12:51 2022] GET /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695 => generated 1728 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:12:52.443961 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-b6448173-4ed5-454a-9110-96d0dc36dcf1 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:12:52.443961 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-b6448173-4ed5-454a-9110-96d0dc36dcf1 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] [instance: 9b886ef6-6c08-4ed8-9d10-35c49c2c6382] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:52.443961 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-b6448173-4ed5-454a-9110-96d0dc36dcf1 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:52.443961 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-b6448173-4ed5-454a-9110-96d0dc36dcf1 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:52.445359 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-b6448173-4ed5-454a-9110-96d0dc36dcf1 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:52.445359 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-b6448173-4ed5-454a-9110-96d0dc36dcf1 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:52.585092 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-b6448173-4ed5-454a-9110-96d0dc36dcf1 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5c39b83f31473696c9b249ab49d780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55dde8892fa47bd9941bb1ce9aa3673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:52.594085 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-b6448173-4ed5-454a-9110-96d0dc36dcf1 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] 10.222.0.79 "GET /compute/v2.1/servers/9b886ef6-6c08-4ed8-9d10-35c49c2c6382" status: 200 len: 1568 microversion: 2.1 time: 0.168519 Jan 28 02:12:52.594774 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 530/1013] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:12:52 2022] GET /compute/v2.1/servers/9b886ef6-6c08-4ed8-9d10-35c49c2c6382 => generated 1568 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:12:52.626446 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-e69eb49f-15ca-47a1-86ce-198e8957b739 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:12:52.627056 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-e69eb49f-15ca-47a1-86ce-198e8957b739 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: c3ea23ca-a790-4f52-ad85-dcac640a8695] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:52.633206 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-e69eb49f-15ca-47a1-86ce-198e8957b739 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:52.633658 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-e69eb49f-15ca-47a1-86ce-198e8957b739 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:52.634477 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-e69eb49f-15ca-47a1-86ce-198e8957b739 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:52.634951 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-e69eb49f-15ca-47a1-86ce-198e8957b739 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:52.772014 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-e69eb49f-15ca-47a1-86ce-198e8957b739 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:52.780633 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-e69eb49f-15ca-47a1-86ce-198e8957b739 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:52.782130 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-e69eb49f-15ca-47a1-86ce-198e8957b739 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:52.783297 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-e69eb49f-15ca-47a1-86ce-198e8957b739 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695" status: 200 len: 1728 microversion: 2.20 time: 0.164584 Jan 28 02:12:52.783858 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 484/1014] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:12:52 2022] GET /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695 => generated 1728 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:12:53.616863 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-8773b00b-abc0-47b1-bbea-1540ca338806 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:12:53.617474 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-8773b00b-abc0-47b1-bbea-1540ca338806 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] [instance: 9b886ef6-6c08-4ed8-9d10-35c49c2c6382] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:53.623230 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-8773b00b-abc0-47b1-bbea-1540ca338806 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:53.623680 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-8773b00b-abc0-47b1-bbea-1540ca338806 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:53.624913 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-8773b00b-abc0-47b1-bbea-1540ca338806 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:53.625150 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-8773b00b-abc0-47b1-bbea-1540ca338806 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:53.711704 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [req-0768208e-f518-441d-8118-e1001030dfff req-b49939c5-2bed-459d-b50d-a2b25fe2a1be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3ea23ca-a790-4f52-ad85-dcac640a8695", "name": "network-vif-plugged", "status": "completed", "tag": "a5ba13e6-3134-4ccb-b060-70df55025709"}]} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:12:53.713351 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:12:53.713351 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: warnings.warn(msg) Jan 28 02:12:53.721034 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-0768208e-f518-441d-8118-e1001030dfff req-b49939c5-2bed-459d-b50d-a2b25fe2a1be service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:53.721730 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-0768208e-f518-441d-8118-e1001030dfff req-b49939c5-2bed-459d-b50d-a2b25fe2a1be service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:53.734193 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.compute.server_external_events [req-0768208e-f518-441d-8118-e1001030dfff req-b49939c5-2bed-459d-b50d-a2b25fe2a1be service nova] Creating event network-vif-plugged:a5ba13e6-3134-4ccb-b060-70df55025709 for instance c3ea23ca-a790-4f52-ad85-dcac640a8695 on hv-cinder-82497 Jan 28 02:12:53.739821 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [req-0768208e-f518-441d-8118-e1001030dfff req-b49939c5-2bed-459d-b50d-a2b25fe2a1be service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031727 Jan 28 02:12:53.740571 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 485/1015] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Jan 28 02:12:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 02:12:53.748793 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-8773b00b-abc0-47b1-bbea-1540ca338806 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5c39b83f31473696c9b249ab49d780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55dde8892fa47bd9941bb1ce9aa3673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:53.756357 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-8773b00b-abc0-47b1-bbea-1540ca338806 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] 10.222.0.79 "GET /compute/v2.1/servers/9b886ef6-6c08-4ed8-9d10-35c49c2c6382" status: 200 len: 1568 microversion: 2.1 time: 0.143705 Jan 28 02:12:53.756955 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 531/1016] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:12:53 2022] GET /compute/v2.1/servers/9b886ef6-6c08-4ed8-9d10-35c49c2c6382 => generated 1568 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:12:53.804563 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-67b04cd8-5468-4b07-9a90-9bfcfbb10d53 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:12:53.808767 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-67b04cd8-5468-4b07-9a90-9bfcfbb10d53 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: c3ea23ca-a790-4f52-ad85-dcac640a8695] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:53.811470 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-67b04cd8-5468-4b07-9a90-9bfcfbb10d53 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:53.811923 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-67b04cd8-5468-4b07-9a90-9bfcfbb10d53 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:53.812804 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-67b04cd8-5468-4b07-9a90-9bfcfbb10d53 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:53.813270 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-67b04cd8-5468-4b07-9a90-9bfcfbb10d53 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:53.960635 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-67b04cd8-5468-4b07-9a90-9bfcfbb10d53 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:53.968438 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-67b04cd8-5468-4b07-9a90-9bfcfbb10d53 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:53.969934 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-67b04cd8-5468-4b07-9a90-9bfcfbb10d53 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:53.971090 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-67b04cd8-5468-4b07-9a90-9bfcfbb10d53 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695" status: 200 len: 1728 microversion: 2.20 time: 0.172050 Jan 28 02:12:53.971911 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 486/1017] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:12:53 2022] GET /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695 => generated 1728 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:12:54.773146 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-c7940a82-ff39-4dfc-9525-4eb86c32b7d5 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:12:54.773748 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-c7940a82-ff39-4dfc-9525-4eb86c32b7d5 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] [instance: 9b886ef6-6c08-4ed8-9d10-35c49c2c6382] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:54.779507 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-c7940a82-ff39-4dfc-9525-4eb86c32b7d5 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:54.779946 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-c7940a82-ff39-4dfc-9525-4eb86c32b7d5 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:54.780752 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-c7940a82-ff39-4dfc-9525-4eb86c32b7d5 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:54.781171 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-c7940a82-ff39-4dfc-9525-4eb86c32b7d5 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:54.947920 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-c7940a82-ff39-4dfc-9525-4eb86c32b7d5 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5c39b83f31473696c9b249ab49d780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55dde8892fa47bd9941bb1ce9aa3673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:54.955267 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-c7940a82-ff39-4dfc-9525-4eb86c32b7d5 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] 10.222.0.79 "GET /compute/v2.1/servers/9b886ef6-6c08-4ed8-9d10-35c49c2c6382" status: 200 len: 1568 microversion: 2.1 time: 0.186279 Jan 28 02:12:54.955919 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 532/1018] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:12:54 2022] GET /compute/v2.1/servers/9b886ef6-6c08-4ed8-9d10-35c49c2c6382 => generated 1568 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:12:54.992776 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-2df4099a-1a47-4bdd-829c-63406457b0ee tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:12:54.993483 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-2df4099a-1a47-4bdd-829c-63406457b0ee tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: c3ea23ca-a790-4f52-ad85-dcac640a8695] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:54.999907 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2df4099a-1a47-4bdd-829c-63406457b0ee tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:55.000464 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2df4099a-1a47-4bdd-829c-63406457b0ee tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:55.001308 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2df4099a-1a47-4bdd-829c-63406457b0ee tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:55.001811 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2df4099a-1a47-4bdd-829c-63406457b0ee tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:55.225302 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-2df4099a-1a47-4bdd-829c-63406457b0ee tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:55.232735 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-2df4099a-1a47-4bdd-829c-63406457b0ee tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:55.234210 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-2df4099a-1a47-4bdd-829c-63406457b0ee tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:55.235366 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-2df4099a-1a47-4bdd-829c-63406457b0ee tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695" status: 200 len: 1728 microversion: 2.20 time: 0.248771 Jan 28 02:12:55.236040 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 487/1019] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:12:54 2022] GET /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695 => generated 1728 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:12:55.973888 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-f3a8df44-7ea6-480e-a2de-db9b9b4b9c86 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:12:55.974401 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-f3a8df44-7ea6-480e-a2de-db9b9b4b9c86 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] [instance: 9b886ef6-6c08-4ed8-9d10-35c49c2c6382] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:55.980232 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-f3a8df44-7ea6-480e-a2de-db9b9b4b9c86 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:55.984831 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-f3a8df44-7ea6-480e-a2de-db9b9b4b9c86 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:55.984831 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-f3a8df44-7ea6-480e-a2de-db9b9b4b9c86 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:55.984831 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-f3a8df44-7ea6-480e-a2de-db9b9b4b9c86 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:56.101752 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-f3a8df44-7ea6-480e-a2de-db9b9b4b9c86 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5c39b83f31473696c9b249ab49d780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55dde8892fa47bd9941bb1ce9aa3673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:56.109518 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-f3a8df44-7ea6-480e-a2de-db9b9b4b9c86 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] 10.222.0.79 "GET /compute/v2.1/servers/9b886ef6-6c08-4ed8-9d10-35c49c2c6382" status: 200 len: 1568 microversion: 2.1 time: 0.140437 Jan 28 02:12:56.110125 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 533/1020] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:12:55 2022] GET /compute/v2.1/servers/9b886ef6-6c08-4ed8-9d10-35c49c2c6382 => generated 1568 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:12:56.254324 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-3361c195-1916-467a-97c8-69e28ab761ae tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:12:56.255321 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-3361c195-1916-467a-97c8-69e28ab761ae tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: c3ea23ca-a790-4f52-ad85-dcac640a8695] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:56.261115 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-3361c195-1916-467a-97c8-69e28ab761ae tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:56.261565 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-3361c195-1916-467a-97c8-69e28ab761ae tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:56.262336 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-3361c195-1916-467a-97c8-69e28ab761ae tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:56.262772 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-3361c195-1916-467a-97c8-69e28ab761ae tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:56.390033 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-3361c195-1916-467a-97c8-69e28ab761ae tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:56.399160 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-3361c195-1916-467a-97c8-69e28ab761ae tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:56.400817 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-3361c195-1916-467a-97c8-69e28ab761ae tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:56.401983 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-3361c195-1916-467a-97c8-69e28ab761ae tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695" status: 200 len: 1728 microversion: 2.20 time: 0.151578 Jan 28 02:12:56.402547 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 488/1021] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:12:56 2022] GET /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695 => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:12:57.132246 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-3c1dcd73-143b-48e8-ab48-7f48975aeee7 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:12:57.132855 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-3c1dcd73-143b-48e8-ab48-7f48975aeee7 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] [instance: 9b886ef6-6c08-4ed8-9d10-35c49c2c6382] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:57.139016 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-3c1dcd73-143b-48e8-ab48-7f48975aeee7 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:57.139451 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-3c1dcd73-143b-48e8-ab48-7f48975aeee7 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:57.140243 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-3c1dcd73-143b-48e8-ab48-7f48975aeee7 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:57.140670 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-3c1dcd73-143b-48e8-ab48-7f48975aeee7 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:57.265680 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-3c1dcd73-143b-48e8-ab48-7f48975aeee7 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5c39b83f31473696c9b249ab49d780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55dde8892fa47bd9941bb1ce9aa3673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:57.273178 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-3c1dcd73-143b-48e8-ab48-7f48975aeee7 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] 10.222.0.79 "GET /compute/v2.1/servers/9b886ef6-6c08-4ed8-9d10-35c49c2c6382" status: 200 len: 1568 microversion: 2.1 time: 0.145388 Jan 28 02:12:57.273778 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 534/1022] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:12:57 2022] GET /compute/v2.1/servers/9b886ef6-6c08-4ed8-9d10-35c49c2c6382 => generated 1568 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:12:57.420416 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-e7194b47-2e5c-497f-8b4b-8a9f2dc990e1 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:12:57.421017 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-e7194b47-2e5c-497f-8b4b-8a9f2dc990e1 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: c3ea23ca-a790-4f52-ad85-dcac640a8695] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:57.426894 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-e7194b47-2e5c-497f-8b4b-8a9f2dc990e1 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:57.427349 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-e7194b47-2e5c-497f-8b4b-8a9f2dc990e1 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:57.428150 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-e7194b47-2e5c-497f-8b4b-8a9f2dc990e1 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:57.428588 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-e7194b47-2e5c-497f-8b4b-8a9f2dc990e1 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:57.547787 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-e7194b47-2e5c-497f-8b4b-8a9f2dc990e1 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:57.555485 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-e7194b47-2e5c-497f-8b4b-8a9f2dc990e1 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:57.557014 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-e7194b47-2e5c-497f-8b4b-8a9f2dc990e1 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:57.558192 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-e7194b47-2e5c-497f-8b4b-8a9f2dc990e1 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695" status: 200 len: 1715 microversion: 2.20 time: 0.141444 Jan 28 02:12:57.558747 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 489/1023] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:12:57 2022] GET /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695 => generated 1715 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:12:58.290637 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-cc63e2ed-79fd-430d-9dce-1aa8db616ae3 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:12:58.291241 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-cc63e2ed-79fd-430d-9dce-1aa8db616ae3 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] [instance: 9b886ef6-6c08-4ed8-9d10-35c49c2c6382] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:58.297238 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-cc63e2ed-79fd-430d-9dce-1aa8db616ae3 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:58.297672 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-cc63e2ed-79fd-430d-9dce-1aa8db616ae3 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:58.298450 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-cc63e2ed-79fd-430d-9dce-1aa8db616ae3 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:58.298875 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-cc63e2ed-79fd-430d-9dce-1aa8db616ae3 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:58.441486 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-cc63e2ed-79fd-430d-9dce-1aa8db616ae3 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5c39b83f31473696c9b249ab49d780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55dde8892fa47bd9941bb1ce9aa3673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:58.443763 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-bb0d6884-edfe-4ff0-ae2b-2fcb61a6a2fc tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:12:58.444747 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-bb0d6884-edfe-4ff0-ae2b-2fcb61a6a2fc tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:58.448935 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-cc63e2ed-79fd-430d-9dce-1aa8db616ae3 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] 10.222.0.79 "GET /compute/v2.1/servers/9b886ef6-6c08-4ed8-9d10-35c49c2c6382" status: 200 len: 1568 microversion: 2.1 time: 0.161923 Jan 28 02:12:58.449509 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 535/1024] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:12:58 2022] GET /compute/v2.1/servers/9b886ef6-6c08-4ed8-9d10-35c49c2c6382 => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:12:58.450725 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-bb0d6884-edfe-4ff0-ae2b-2fcb61a6a2fc tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:58.451173 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-bb0d6884-edfe-4ff0-ae2b-2fcb61a6a2fc tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:58.451932 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-bb0d6884-edfe-4ff0-ae2b-2fcb61a6a2fc tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:58.452465 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-bb0d6884-edfe-4ff0-ae2b-2fcb61a6a2fc tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:58.481960 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-bb0d6884-edfe-4ff0-ae2b-2fcb61a6a2fc tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "GET /compute/v2.1/servers/ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042156 Jan 28 02:12:58.482499 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 490/1025] 10.222.0.79 () {58 vars in 1301 bytes} [Fri Jan 28 02:12:58 2022] GET /compute/v2.1/servers/ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:12:58.492757 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-b3c828a8-7c50-49fe-b38b-806b1007bb9d tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:12:58.493274 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-b3c828a8-7c50-49fe-b38b-806b1007bb9d tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:58.499203 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-b3c828a8-7c50-49fe-b38b-806b1007bb9d tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:58.499654 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-b3c828a8-7c50-49fe-b38b-806b1007bb9d tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:58.500453 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-b3c828a8-7c50-49fe-b38b-806b1007bb9d tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:58.500892 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-b3c828a8-7c50-49fe-b38b-806b1007bb9d tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:58.528914 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-b3c828a8-7c50-49fe-b38b-806b1007bb9d tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "GET /compute/v2.1/servers/ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc/os-volume_attachments/a604cf08-46b7-442e-a64e-a848da92be40" status: 200 len: 194 microversion: 2.1 time: 0.039974 Jan 28 02:12:58.529499 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 536/1026] 10.222.0.79 () {58 vars in 1412 bytes} [Fri Jan 28 02:12:58 2022] GET /compute/v2.1/servers/ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc/os-volume_attachments/a604cf08-46b7-442e-a64e-a848da92be40 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:12:59.466441 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-4663e877-760f-43c4-ae4c-86109f5554ac tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:12:59.467063 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-4663e877-760f-43c4-ae4c-86109f5554ac tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] [instance: 9b886ef6-6c08-4ed8-9d10-35c49c2c6382] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:12:59.473838 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-4663e877-760f-43c4-ae4c-86109f5554ac tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:59.474308 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-4663e877-760f-43c4-ae4c-86109f5554ac tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:59.475072 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-4663e877-760f-43c4-ae4c-86109f5554ac tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:12:59.475502 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-4663e877-760f-43c4-ae4c-86109f5554ac tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:12:59.596832 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-4663e877-760f-43c4-ae4c-86109f5554ac tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5c39b83f31473696c9b249ab49d780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55dde8892fa47bd9941bb1ce9aa3673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:12:59.604923 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-4663e877-760f-43c4-ae4c-86109f5554ac tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] 10.222.0.79 "GET /compute/v2.1/servers/9b886ef6-6c08-4ed8-9d10-35c49c2c6382" status: 200 len: 1568 microversion: 2.1 time: 0.142167 Jan 28 02:12:59.605499 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 491/1027] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:12:59 2022] GET /compute/v2.1/servers/9b886ef6-6c08-4ed8-9d10-35c49c2c6382 => generated 1568 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:13:00.164463 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-fbe64545-f89c-4fea-ad33-182ce85bec2d tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "426f33da-59af-4061-be7e-02b2e0a688e7"}} {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:13:00.165572 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-fbe64545-f89c-4fea-ad33-182ce85bec2d tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:13:00.171328 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-fbe64545-f89c-4fea-ad33-182ce85bec2d tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:13:00.171769 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-fbe64545-f89c-4fea-ad33-182ce85bec2d tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:13:00.172561 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-fbe64545-f89c-4fea-ad33-182ce85bec2d tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:13:00.172984 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-fbe64545-f89c-4fea-ad33-182ce85bec2d tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:13:00.621411 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-ab89e743-b8b1-4747-a4c3-61f569ffbee1 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:13:00.621992 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-ab89e743-b8b1-4747-a4c3-61f569ffbee1 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] [instance: 9b886ef6-6c08-4ed8-9d10-35c49c2c6382] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:13:00.627692 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ab89e743-b8b1-4747-a4c3-61f569ffbee1 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:13:00.628821 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ab89e743-b8b1-4747-a4c3-61f569ffbee1 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:13:00.629579 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ab89e743-b8b1-4747-a4c3-61f569ffbee1 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:13:00.630044 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ab89e743-b8b1-4747-a4c3-61f569ffbee1 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:13:00.749663 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-ab89e743-b8b1-4747-a4c3-61f569ffbee1 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5c39b83f31473696c9b249ab49d780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55dde8892fa47bd9941bb1ce9aa3673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:13:00.756806 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-ab89e743-b8b1-4747-a4c3-61f569ffbee1 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] 10.222.0.79 "GET /compute/v2.1/servers/9b886ef6-6c08-4ed8-9d10-35c49c2c6382" status: 200 len: 1568 microversion: 2.1 time: 0.139154 Jan 28 02:13:00.757394 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 492/1028] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:13:00 2022] GET /compute/v2.1/servers/9b886ef6-6c08-4ed8-9d10-35c49c2c6382 => generated 1568 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:13:01.042290 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-fbe64545-f89c-4fea-ad33-182ce85bec2d tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "POST /compute/v2.1/servers/ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.881302 Jan 28 02:13:01.042964 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 537/1029] 10.222.0.79 () {60 vars in 1322 bytes} [Fri Jan 28 02:13:00 2022] POST /compute/v2.1/servers/ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc/os-volume_attachments => generated 194 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:13:01.774666 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-c0374bc1-9d8e-439c-8e92-19f7659e98ff tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:13:01.775291 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-c0374bc1-9d8e-439c-8e92-19f7659e98ff tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] [instance: 9b886ef6-6c08-4ed8-9d10-35c49c2c6382] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:13:01.781324 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c0374bc1-9d8e-439c-8e92-19f7659e98ff tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:13:01.781763 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c0374bc1-9d8e-439c-8e92-19f7659e98ff tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:13:01.782528 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c0374bc1-9d8e-439c-8e92-19f7659e98ff tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:13:01.782958 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c0374bc1-9d8e-439c-8e92-19f7659e98ff tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:13:01.900778 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-c0374bc1-9d8e-439c-8e92-19f7659e98ff tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5c39b83f31473696c9b249ab49d780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55dde8892fa47bd9941bb1ce9aa3673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:13:01.908142 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-c0374bc1-9d8e-439c-8e92-19f7659e98ff tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] 10.222.0.79 "GET /compute/v2.1/servers/9b886ef6-6c08-4ed8-9d10-35c49c2c6382" status: 200 len: 1568 microversion: 2.1 time: 0.137202 Jan 28 02:13:01.917049 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 493/1030] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:13:01 2022] GET /compute/v2.1/servers/9b886ef6-6c08-4ed8-9d10-35c49c2c6382 => generated 1568 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:13:02.926454 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-dd5b018e-0700-45b6-92af-dcd6d3bb6c58 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:13:02.927134 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-dd5b018e-0700-45b6-92af-dcd6d3bb6c58 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] [instance: 9b886ef6-6c08-4ed8-9d10-35c49c2c6382] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:13:02.934070 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-dd5b018e-0700-45b6-92af-dcd6d3bb6c58 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:13:02.934509 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-dd5b018e-0700-45b6-92af-dcd6d3bb6c58 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:13:02.935255 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-dd5b018e-0700-45b6-92af-dcd6d3bb6c58 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:13:02.935677 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-dd5b018e-0700-45b6-92af-dcd6d3bb6c58 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:13:03.056362 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-dd5b018e-0700-45b6-92af-dcd6d3bb6c58 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5c39b83f31473696c9b249ab49d780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55dde8892fa47bd9941bb1ce9aa3673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:13:03.063858 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-dd5b018e-0700-45b6-92af-dcd6d3bb6c58 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] 10.222.0.79 "GET /compute/v2.1/servers/9b886ef6-6c08-4ed8-9d10-35c49c2c6382" status: 200 len: 1509 microversion: 2.1 time: 0.141944 Jan 28 02:13:03.064464 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 538/1031] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:13:02 2022] GET /compute/v2.1/servers/9b886ef6-6c08-4ed8-9d10-35c49c2c6382 => generated 1509 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:13:03.080270 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-f71c833a-9f1c-44de-b6d4-5f6f0e0099b0 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:13:03.080835 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-f71c833a-9f1c-44de-b6d4-5f6f0e0099b0 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] [instance: 9b886ef6-6c08-4ed8-9d10-35c49c2c6382] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:13:03.086678 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f71c833a-9f1c-44de-b6d4-5f6f0e0099b0 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:13:03.087126 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f71c833a-9f1c-44de-b6d4-5f6f0e0099b0 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:13:03.087888 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f71c833a-9f1c-44de-b6d4-5f6f0e0099b0 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:13:03.088349 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f71c833a-9f1c-44de-b6d4-5f6f0e0099b0 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:13:03.329621 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-f71c833a-9f1c-44de-b6d4-5f6f0e0099b0 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] 10.222.0.79 "POST /compute/v2.1/servers/9b886ef6-6c08-4ed8-9d10-35c49c2c6382/action" status: 202 len: 0 microversion: 2.1 time: 0.252939 Jan 28 02:13:03.330316 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 494/1032] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Jan 28 02:13:03 2022] POST /compute/v2.1/servers/9b886ef6-6c08-4ed8-9d10-35c49c2c6382/action => generated 0 bytes in 254 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:13:03.338358 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-f28bf3d2-10e1-40d2-bdd1-469997b80930 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:13:03.339021 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-f28bf3d2-10e1-40d2-bdd1-469997b80930 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] [instance: 9b886ef6-6c08-4ed8-9d10-35c49c2c6382] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:13:03.344764 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-f28bf3d2-10e1-40d2-bdd1-469997b80930 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:13:03.345203 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-f28bf3d2-10e1-40d2-bdd1-469997b80930 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:13:03.345959 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-f28bf3d2-10e1-40d2-bdd1-469997b80930 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:13:03.346398 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-f28bf3d2-10e1-40d2-bdd1-469997b80930 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:13:03.466889 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-f28bf3d2-10e1-40d2-bdd1-469997b80930 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5c39b83f31473696c9b249ab49d780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55dde8892fa47bd9941bb1ce9aa3673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:13:03.475526 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-f28bf3d2-10e1-40d2-bdd1-469997b80930 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] 10.222.0.79 "GET /compute/v2.1/servers/9b886ef6-6c08-4ed8-9d10-35c49c2c6382" status: 200 len: 1517 microversion: 2.1 time: 0.140747 Jan 28 02:13:03.479377 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 539/1033] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:13:03 2022] GET /compute/v2.1/servers/9b886ef6-6c08-4ed8-9d10-35c49c2c6382 => generated 1517 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:13:03.743643 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [req-7078bf45-e133-4fbe-898d-f856cadb5905 req-61400ac4-7d20-4c3c-b00e-2eb0e1afe4df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b886ef6-6c08-4ed8-9d10-35c49c2c6382", "name": "network-vif-unplugged", "status": "completed", "tag": "7b4575d4-25de-48a0-8c88-24340312c99a"}]} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:13:03.745243 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:13:03.745243 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: warnings.warn(msg) Jan 28 02:13:03.752174 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-7078bf45-e133-4fbe-898d-f856cadb5905 req-61400ac4-7d20-4c3c-b00e-2eb0e1afe4df service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:13:03.752615 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-7078bf45-e133-4fbe-898d-f856cadb5905 req-61400ac4-7d20-4c3c-b00e-2eb0e1afe4df service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:13:03.763674 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.compute.server_external_events [req-7078bf45-e133-4fbe-898d-f856cadb5905 req-61400ac4-7d20-4c3c-b00e-2eb0e1afe4df service nova] Unable to find a host for instance 9b886ef6-6c08-4ed8-9d10-35c49c2c6382. Dropping event network-vif-unplugged {{(pid=116375) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Jan 28 02:13:03.764633 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [req-7078bf45-e133-4fbe-898d-f856cadb5905 req-61400ac4-7d20-4c3c-b00e-2eb0e1afe4df service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.024894 Jan 28 02:13:03.765238 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 495/1034] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Jan 28 02:13:03 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 26 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jan 28 02:13:04.492659 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-5070db58-e7a2-4370-ae92-6c3f85c30074 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:13:04.493264 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-5070db58-e7a2-4370-ae92-6c3f85c30074 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] [instance: 9b886ef6-6c08-4ed8-9d10-35c49c2c6382] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:13:04.499089 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-5070db58-e7a2-4370-ae92-6c3f85c30074 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:13:04.499534 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-5070db58-e7a2-4370-ae92-6c3f85c30074 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:13:04.500326 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-5070db58-e7a2-4370-ae92-6c3f85c30074 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:13:04.500759 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-5070db58-e7a2-4370-ae92-6c3f85c30074 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:13:04.617740 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-5070db58-e7a2-4370-ae92-6c3f85c30074 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5c39b83f31473696c9b249ab49d780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55dde8892fa47bd9941bb1ce9aa3673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:13:04.624913 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-5070db58-e7a2-4370-ae92-6c3f85c30074 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] 10.222.0.79 "GET /compute/v2.1/servers/9b886ef6-6c08-4ed8-9d10-35c49c2c6382" status: 200 len: 1519 microversion: 2.1 time: 0.135927 Jan 28 02:13:04.625475 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 540/1035] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:13:04 2022] GET /compute/v2.1/servers/9b886ef6-6c08-4ed8-9d10-35c49c2c6382 => generated 1519 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:13:05.642343 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-e9ff4390-1d45-4fc4-af96-c7e10769d81d tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:13:05.642889 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-e9ff4390-1d45-4fc4-af96-c7e10769d81d tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] [instance: 9b886ef6-6c08-4ed8-9d10-35c49c2c6382] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:13:05.649258 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-e9ff4390-1d45-4fc4-af96-c7e10769d81d tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:13:05.649700 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-e9ff4390-1d45-4fc4-af96-c7e10769d81d tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:13:05.650456 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-e9ff4390-1d45-4fc4-af96-c7e10769d81d tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:13:05.650916 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-e9ff4390-1d45-4fc4-af96-c7e10769d81d tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:13:05.770118 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-e9ff4390-1d45-4fc4-af96-c7e10769d81d tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5c39b83f31473696c9b249ab49d780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55dde8892fa47bd9941bb1ce9aa3673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:13:05.777284 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-e9ff4390-1d45-4fc4-af96-c7e10769d81d tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] 10.222.0.79 "GET /compute/v2.1/servers/9b886ef6-6c08-4ed8-9d10-35c49c2c6382" status: 200 len: 1519 microversion: 2.1 time: 0.138733 Jan 28 02:13:05.777842 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 496/1036] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:13:05 2022] GET /compute/v2.1/servers/9b886ef6-6c08-4ed8-9d10-35c49c2c6382 => generated 1519 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:13:06.793989 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-3f6c3b44-f6b3-4d97-ba59-eab7cb2b9d9e tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:13:06.794614 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-3f6c3b44-f6b3-4d97-ba59-eab7cb2b9d9e tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] [instance: 9b886ef6-6c08-4ed8-9d10-35c49c2c6382] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:13:06.801299 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-3f6c3b44-f6b3-4d97-ba59-eab7cb2b9d9e tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:13:06.801739 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-3f6c3b44-f6b3-4d97-ba59-eab7cb2b9d9e tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:13:06.802494 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-3f6c3b44-f6b3-4d97-ba59-eab7cb2b9d9e tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:13:06.802924 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-3f6c3b44-f6b3-4d97-ba59-eab7cb2b9d9e tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:13:06.919302 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-3f6c3b44-f6b3-4d97-ba59-eab7cb2b9d9e tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5c39b83f31473696c9b249ab49d780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55dde8892fa47bd9941bb1ce9aa3673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:13:06.927006 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-3f6c3b44-f6b3-4d97-ba59-eab7cb2b9d9e tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] 10.222.0.79 "GET /compute/v2.1/servers/9b886ef6-6c08-4ed8-9d10-35c49c2c6382" status: 200 len: 1519 microversion: 2.1 time: 0.136692 Jan 28 02:13:06.927572 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 541/1037] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:13:06 2022] GET /compute/v2.1/servers/9b886ef6-6c08-4ed8-9d10-35c49c2c6382 => generated 1519 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:13:07.945267 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-a840a2e4-aefd-4f04-9223-21b30325e061 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:13:07.945867 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-a840a2e4-aefd-4f04-9223-21b30325e061 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] [instance: 9b886ef6-6c08-4ed8-9d10-35c49c2c6382] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:13:07.952597 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a840a2e4-aefd-4f04-9223-21b30325e061 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:13:07.952783 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a840a2e4-aefd-4f04-9223-21b30325e061 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:13:07.953552 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a840a2e4-aefd-4f04-9223-21b30325e061 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:13:07.953984 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a840a2e4-aefd-4f04-9223-21b30325e061 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:13:08.072652 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-a840a2e4-aefd-4f04-9223-21b30325e061 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5c39b83f31473696c9b249ab49d780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55dde8892fa47bd9941bb1ce9aa3673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:13:08.079784 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-a840a2e4-aefd-4f04-9223-21b30325e061 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] 10.222.0.79 "GET /compute/v2.1/servers/9b886ef6-6c08-4ed8-9d10-35c49c2c6382" status: 200 len: 1519 microversion: 2.1 time: 0.139848 Jan 28 02:13:08.080375 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 497/1038] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:13:07 2022] GET /compute/v2.1/servers/9b886ef6-6c08-4ed8-9d10-35c49c2c6382 => generated 1519 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:13:09.098389 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-5d4f2c3b-8fb6-4490-94c7-7b051490190b tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:13:09.099022 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-5d4f2c3b-8fb6-4490-94c7-7b051490190b tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] [instance: 9b886ef6-6c08-4ed8-9d10-35c49c2c6382] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:13:09.104944 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-5d4f2c3b-8fb6-4490-94c7-7b051490190b tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:13:09.105393 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-5d4f2c3b-8fb6-4490-94c7-7b051490190b tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:13:09.106188 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-5d4f2c3b-8fb6-4490-94c7-7b051490190b tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:13:09.106626 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-5d4f2c3b-8fb6-4490-94c7-7b051490190b tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:13:09.228355 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-5d4f2c3b-8fb6-4490-94c7-7b051490190b tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5c39b83f31473696c9b249ab49d780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55dde8892fa47bd9941bb1ce9aa3673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:13:09.235689 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-5d4f2c3b-8fb6-4490-94c7-7b051490190b tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] 10.222.0.79 "GET /compute/v2.1/servers/9b886ef6-6c08-4ed8-9d10-35c49c2c6382" status: 200 len: 1519 microversion: 2.1 time: 0.141882 Jan 28 02:13:09.236292 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 542/1039] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:13:09 2022] GET /compute/v2.1/servers/9b886ef6-6c08-4ed8-9d10-35c49c2c6382 => generated 1519 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:13:09.624182 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-e37c9ea1-466a-4c70-9c41-23c465794316 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:13:09.625090 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-e37c9ea1-466a-4c70-9c41-23c465794316 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:13:09.631265 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-e37c9ea1-466a-4c70-9c41-23c465794316 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:13:09.631711 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-e37c9ea1-466a-4c70-9c41-23c465794316 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:13:09.632506 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-e37c9ea1-466a-4c70-9c41-23c465794316 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:13:09.632939 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-e37c9ea1-466a-4c70-9c41-23c465794316 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:13:09.662279 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-e37c9ea1-466a-4c70-9c41-23c465794316 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "GET /compute/v2.1/servers/ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041815 Jan 28 02:13:09.662837 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 498/1040] 10.222.0.79 () {58 vars in 1301 bytes} [Fri Jan 28 02:13:09 2022] GET /compute/v2.1/servers/ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:13:09.928949 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-db63c71e-7d53-47c3-b056-62ff53370ff3 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:13:09.929426 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-db63c71e-7d53-47c3-b056-62ff53370ff3 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:13:09.935349 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-db63c71e-7d53-47c3-b056-62ff53370ff3 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:13:09.935794 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-db63c71e-7d53-47c3-b056-62ff53370ff3 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:13:09.936820 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-db63c71e-7d53-47c3-b056-62ff53370ff3 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:13:09.937012 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-db63c71e-7d53-47c3-b056-62ff53370ff3 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:13:09.966230 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-db63c71e-7d53-47c3-b056-62ff53370ff3 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "GET /compute/v2.1/servers/ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc/os-volume_attachments/a604cf08-46b7-442e-a64e-a848da92be40" status: 200 len: 194 microversion: 2.1 time: 0.041754 Jan 28 02:13:09.966813 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 543/1041] 10.222.0.79 () {58 vars in 1412 bytes} [Fri Jan 28 02:13:09 2022] GET /compute/v2.1/servers/ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc/os-volume_attachments/a604cf08-46b7-442e-a64e-a848da92be40 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:13:09.976570 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-a043bddd-5105-4b98-b930-8d4b676e4323 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:13:09.977110 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-a043bddd-5105-4b98-b930-8d4b676e4323 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:13:09.982768 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a043bddd-5105-4b98-b930-8d4b676e4323 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:13:09.983223 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a043bddd-5105-4b98-b930-8d4b676e4323 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:13:09.983997 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a043bddd-5105-4b98-b930-8d4b676e4323 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:13:09.984454 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a043bddd-5105-4b98-b930-8d4b676e4323 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:13:10.069083 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.objects.instance [None req-a043bddd-5105-4b98-b930-8d4b676e4323 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lazy-loading 'services' on Instance uuid ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc {{(pid=116375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jan 28 02:13:10.252427 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-140f9a04-e3b8-4598-b638-46f7ee845e9b tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:13:10.253068 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-140f9a04-e3b8-4598-b638-46f7ee845e9b tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] [instance: 9b886ef6-6c08-4ed8-9d10-35c49c2c6382] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:13:10.258733 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-140f9a04-e3b8-4598-b638-46f7ee845e9b tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:13:10.259178 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-140f9a04-e3b8-4598-b638-46f7ee845e9b tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:13:10.259965 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-140f9a04-e3b8-4598-b638-46f7ee845e9b tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:13:10.260416 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-140f9a04-e3b8-4598-b638-46f7ee845e9b tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:13:10.318252 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-a043bddd-5105-4b98-b930-8d4b676e4323 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "DELETE /compute/v2.1/servers/ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc/os-volume_attachments/a604cf08-46b7-442e-a64e-a848da92be40" status: 202 len: 0 microversion: 2.1 time: 0.345151 Jan 28 02:13:10.318896 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 499/1042] 10.222.0.79 () {58 vars in 1415 bytes} [Fri Jan 28 02:13:09 2022] DELETE /compute/v2.1/servers/ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc/os-volume_attachments/a604cf08-46b7-442e-a64e-a848da92be40 => generated 0 bytes in 347 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:13:10.385353 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-140f9a04-e3b8-4598-b638-46f7ee845e9b tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5c39b83f31473696c9b249ab49d780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55dde8892fa47bd9941bb1ce9aa3673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:13:10.392972 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-140f9a04-e3b8-4598-b638-46f7ee845e9b tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] 10.222.0.79 "GET /compute/v2.1/servers/9b886ef6-6c08-4ed8-9d10-35c49c2c6382" status: 200 len: 1519 microversion: 2.1 time: 0.144106 Jan 28 02:13:10.393691 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 544/1043] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:13:10 2022] GET /compute/v2.1/servers/9b886ef6-6c08-4ed8-9d10-35c49c2c6382 => generated 1519 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:13:11.410575 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-a986ad1d-5cc1-4412-81f6-0e511cb7202b tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:13:11.412115 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-a986ad1d-5cc1-4412-81f6-0e511cb7202b tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] [instance: 9b886ef6-6c08-4ed8-9d10-35c49c2c6382] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:13:11.417817 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a986ad1d-5cc1-4412-81f6-0e511cb7202b tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:13:11.418390 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a986ad1d-5cc1-4412-81f6-0e511cb7202b tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:13:11.419270 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a986ad1d-5cc1-4412-81f6-0e511cb7202b tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:13:11.419920 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a986ad1d-5cc1-4412-81f6-0e511cb7202b tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:13:11.584186 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-a986ad1d-5cc1-4412-81f6-0e511cb7202b tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5c39b83f31473696c9b249ab49d780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55dde8892fa47bd9941bb1ce9aa3673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:13:11.591377 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-a986ad1d-5cc1-4412-81f6-0e511cb7202b tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] 10.222.0.79 "GET /compute/v2.1/servers/9b886ef6-6c08-4ed8-9d10-35c49c2c6382" status: 200 len: 1575 microversion: 2.1 time: 0.185067 Jan 28 02:13:11.591943 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 500/1044] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:13:11 2022] GET /compute/v2.1/servers/9b886ef6-6c08-4ed8-9d10-35c49c2c6382 => generated 1575 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:13:12.505817 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-c517782e-0e6f-4e1b-840f-f29b5d1182a4 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:13:12.506309 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-c517782e-0e6f-4e1b-840f-f29b5d1182a4 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:13:12.512474 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-c517782e-0e6f-4e1b-840f-f29b5d1182a4 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:13:12.512917 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-c517782e-0e6f-4e1b-840f-f29b5d1182a4 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:13:12.513710 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-c517782e-0e6f-4e1b-840f-f29b5d1182a4 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:13:12.514294 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-c517782e-0e6f-4e1b-840f-f29b5d1182a4 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:13:12.544572 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-c517782e-0e6f-4e1b-840f-f29b5d1182a4 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "GET /compute/v2.1/servers/ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc/os-volume_attachments/426f33da-59af-4061-be7e-02b2e0a688e7" status: 200 len: 194 microversion: 2.1 time: 0.043122 Jan 28 02:13:12.545150 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 545/1045] 10.222.0.79 () {58 vars in 1412 bytes} [Fri Jan 28 02:13:12 2022] GET /compute/v2.1/servers/ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc/os-volume_attachments/426f33da-59af-4061-be7e-02b2e0a688e7 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:13:12.554783 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-a2874201-9065-4bbb-b095-3b2aeed3d571 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:13:12.555264 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-a2874201-9065-4bbb-b095-3b2aeed3d571 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:13:12.560993 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a2874201-9065-4bbb-b095-3b2aeed3d571 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:13:12.561433 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a2874201-9065-4bbb-b095-3b2aeed3d571 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:13:12.562181 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a2874201-9065-4bbb-b095-3b2aeed3d571 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:13:12.562609 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a2874201-9065-4bbb-b095-3b2aeed3d571 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:13:12.609197 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-cc5d8107-861e-4e81-8c5d-61a0d590893b tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:13:12.609795 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-cc5d8107-861e-4e81-8c5d-61a0d590893b tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] [instance: 9b886ef6-6c08-4ed8-9d10-35c49c2c6382] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:13:12.615473 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-cc5d8107-861e-4e81-8c5d-61a0d590893b tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:13:12.615913 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-cc5d8107-861e-4e81-8c5d-61a0d590893b tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:13:12.616724 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-cc5d8107-861e-4e81-8c5d-61a0d590893b tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:13:12.617148 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-cc5d8107-861e-4e81-8c5d-61a0d590893b tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:13:12.645849 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.objects.instance [None req-a2874201-9065-4bbb-b095-3b2aeed3d571 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lazy-loading 'services' on Instance uuid ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc {{(pid=116375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jan 28 02:13:12.746175 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-cc5d8107-861e-4e81-8c5d-61a0d590893b tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5c39b83f31473696c9b249ab49d780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55dde8892fa47bd9941bb1ce9aa3673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:13:12.755015 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-cc5d8107-861e-4e81-8c5d-61a0d590893b tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] 10.222.0.79 "GET /compute/v2.1/servers/9b886ef6-6c08-4ed8-9d10-35c49c2c6382" status: 200 len: 1575 microversion: 2.1 time: 0.149765 Jan 28 02:13:12.755575 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 546/1046] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:13:12 2022] GET /compute/v2.1/servers/9b886ef6-6c08-4ed8-9d10-35c49c2c6382 => generated 1575 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:13:12.847549 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-a2874201-9065-4bbb-b095-3b2aeed3d571 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "DELETE /compute/v2.1/servers/ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc/os-volume_attachments/426f33da-59af-4061-be7e-02b2e0a688e7" status: 202 len: 0 microversion: 2.1 time: 0.296036 Jan 28 02:13:12.848193 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 501/1047] 10.222.0.79 () {58 vars in 1415 bytes} [Fri Jan 28 02:13:12 2022] DELETE /compute/v2.1/servers/ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc/os-volume_attachments/426f33da-59af-4061-be7e-02b2e0a688e7 => generated 0 bytes in 298 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:13:13.772714 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-14ae7090-6514-44fd-9504-4231860eee55 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:13:13.773309 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-14ae7090-6514-44fd-9504-4231860eee55 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] [instance: 9b886ef6-6c08-4ed8-9d10-35c49c2c6382] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:13:13.779252 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-14ae7090-6514-44fd-9504-4231860eee55 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:13:13.779698 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-14ae7090-6514-44fd-9504-4231860eee55 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:13:13.780478 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-14ae7090-6514-44fd-9504-4231860eee55 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:13:13.780905 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-14ae7090-6514-44fd-9504-4231860eee55 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:13:13.900692 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-14ae7090-6514-44fd-9504-4231860eee55 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5c39b83f31473696c9b249ab49d780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55dde8892fa47bd9941bb1ce9aa3673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:13:13.907867 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-14ae7090-6514-44fd-9504-4231860eee55 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] 10.222.0.79 "GET /compute/v2.1/servers/9b886ef6-6c08-4ed8-9d10-35c49c2c6382" status: 200 len: 1575 microversion: 2.1 time: 0.139469 Jan 28 02:13:13.908497 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 547/1048] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:13:13 2022] GET /compute/v2.1/servers/9b886ef6-6c08-4ed8-9d10-35c49c2c6382 => generated 1575 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:13:14.926528 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-a49c2506-094d-4fd7-a699-d339adc3ad3a tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:13:14.927127 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-a49c2506-094d-4fd7-a699-d339adc3ad3a tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] [instance: 9b886ef6-6c08-4ed8-9d10-35c49c2c6382] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:13:14.933207 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a49c2506-094d-4fd7-a699-d339adc3ad3a tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:13:14.933645 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a49c2506-094d-4fd7-a699-d339adc3ad3a tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:13:14.934397 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a49c2506-094d-4fd7-a699-d339adc3ad3a tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:13:14.934819 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a49c2506-094d-4fd7-a699-d339adc3ad3a tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:13:15.054083 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-a49c2506-094d-4fd7-a699-d339adc3ad3a tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5c39b83f31473696c9b249ab49d780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55dde8892fa47bd9941bb1ce9aa3673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:13:15.061401 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-a49c2506-094d-4fd7-a699-d339adc3ad3a tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] 10.222.0.79 "GET /compute/v2.1/servers/9b886ef6-6c08-4ed8-9d10-35c49c2c6382" status: 200 len: 1575 microversion: 2.1 time: 0.139690 Jan 28 02:13:15.061970 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 502/1049] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:13:14 2022] GET /compute/v2.1/servers/9b886ef6-6c08-4ed8-9d10-35c49c2c6382 => generated 1575 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:13:15.077727 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-fd1e1521-4f02-4b4c-bde2-465e4e5151e6 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:13:15.078676 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-fd1e1521-4f02-4b4c-bde2-465e4e5151e6 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:13:15.085023 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-fd1e1521-4f02-4b4c-bde2-465e4e5151e6 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:13:15.085471 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-fd1e1521-4f02-4b4c-bde2-465e4e5151e6 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:13:15.086238 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-fd1e1521-4f02-4b4c-bde2-465e4e5151e6 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:13:15.086669 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-fd1e1521-4f02-4b4c-bde2-465e4e5151e6 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:13:15.116097 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-fd1e1521-4f02-4b4c-bde2-465e4e5151e6 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "GET /compute/v2.1/servers/ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042042 Jan 28 02:13:15.116635 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 548/1050] 10.222.0.79 () {58 vars in 1301 bytes} [Fri Jan 28 02:13:15 2022] GET /compute/v2.1/servers/ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 02:13:15.226811 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-46a0ac2a-1585-4efb-912f-bcf2924121a5 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:13:15.227791 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-46a0ac2a-1585-4efb-912f-bcf2924121a5 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:13:15.233705 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-46a0ac2a-1585-4efb-912f-bcf2924121a5 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:13:15.234153 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-46a0ac2a-1585-4efb-912f-bcf2924121a5 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:13:15.234911 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-46a0ac2a-1585-4efb-912f-bcf2924121a5 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:13:15.235346 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-46a0ac2a-1585-4efb-912f-bcf2924121a5 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:13:15.263014 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-46a0ac2a-1585-4efb-912f-bcf2924121a5 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "GET /compute/v2.1/servers/ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.039887 Jan 28 02:13:15.263563 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 503/1051] 10.222.0.79 () {58 vars in 1301 bytes} [Fri Jan 28 02:13:15 2022] GET /compute/v2.1/servers/ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc/os-volume_attachments => generated 25 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 02:13:15.323032 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-4590ca2c-bd76-4d06-a746-eaf3e18ed2dc tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:13:15.323514 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-4590ca2c-bd76-4d06-a746-eaf3e18ed2dc tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:13:15.329385 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-4590ca2c-bd76-4d06-a746-eaf3e18ed2dc tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:13:15.329823 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-4590ca2c-bd76-4d06-a746-eaf3e18ed2dc tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:13:15.330576 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-4590ca2c-bd76-4d06-a746-eaf3e18ed2dc tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:13:15.331714 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-4590ca2c-bd76-4d06-a746-eaf3e18ed2dc tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:13:15.355596 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-4590ca2c-bd76-4d06-a746-eaf3e18ed2dc tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc] Going to try to terminate instance {{(pid=116374) delete /opt/stack/nova/nova/compute/api.py:2612}} Jan 28 02:13:15.660741 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-4590ca2c-bd76-4d06-a746-eaf3e18ed2dc tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "DELETE /compute/v2.1/servers/ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc" status: 204 len: 0 microversion: 2.1 time: 0.340992 Jan 28 02:13:15.661329 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 549/1052] 10.222.0.79 () {58 vars in 1238 bytes} [Fri Jan 28 02:13:15 2022] DELETE /compute/v2.1/servers/ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc => generated 0 bytes in 342 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 28 02:13:15.669142 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-25f5d3dc-5307-4a7d-b30d-670982b799df tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:13:15.669802 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-25f5d3dc-5307-4a7d-b30d-670982b799df tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:13:15.675520 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-25f5d3dc-5307-4a7d-b30d-670982b799df tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:13:15.675961 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-25f5d3dc-5307-4a7d-b30d-670982b799df tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:13:15.676745 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-25f5d3dc-5307-4a7d-b30d-670982b799df tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:13:15.677190 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-25f5d3dc-5307-4a7d-b30d-670982b799df tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:13:15.798624 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-25f5d3dc-5307-4a7d-b30d-670982b799df tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acab2a0c4a0e48909317791a3de85b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abe012ba65845329098e0e06c54b9c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:13:15.806844 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-25f5d3dc-5307-4a7d-b30d-670982b799df tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "GET /compute/v2.1/servers/ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc" status: 200 len: 1673 microversion: 2.1 time: 0.141274 Jan 28 02:13:15.807417 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 504/1053] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:13:15 2022] GET /compute/v2.1/servers/ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc => generated 1673 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:13:16.079008 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-0677ea54-d266-4701-ad03-d32cdeaebfde tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:13:16.079621 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-0677ea54-d266-4701-ad03-d32cdeaebfde tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] [instance: 9b886ef6-6c08-4ed8-9d10-35c49c2c6382] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:13:16.086123 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-0677ea54-d266-4701-ad03-d32cdeaebfde tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:13:16.086562 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-0677ea54-d266-4701-ad03-d32cdeaebfde tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:13:16.087319 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-0677ea54-d266-4701-ad03-d32cdeaebfde tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:13:16.087748 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-0677ea54-d266-4701-ad03-d32cdeaebfde tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:13:16.206379 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-0677ea54-d266-4701-ad03-d32cdeaebfde tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5c39b83f31473696c9b249ab49d780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55dde8892fa47bd9941bb1ce9aa3673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:13:16.213578 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-0677ea54-d266-4701-ad03-d32cdeaebfde tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] 10.222.0.79 "GET /compute/v2.1/servers/9b886ef6-6c08-4ed8-9d10-35c49c2c6382" status: 200 len: 1575 microversion: 2.1 time: 0.138663 Jan 28 02:13:16.214141 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 550/1054] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:13:16 2022] GET /compute/v2.1/servers/9b886ef6-6c08-4ed8-9d10-35c49c2c6382 => generated 1575 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:13:16.824284 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-4c03864c-81ef-453b-bc86-6caabb3197dc tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:13:16.824887 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-4c03864c-81ef-453b-bc86-6caabb3197dc tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:13:16.830638 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-4c03864c-81ef-453b-bc86-6caabb3197dc tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:13:16.831090 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-4c03864c-81ef-453b-bc86-6caabb3197dc tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:13:16.831838 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-4c03864c-81ef-453b-bc86-6caabb3197dc tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:13:16.832298 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-4c03864c-81ef-453b-bc86-6caabb3197dc tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:13:16.949575 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-4c03864c-81ef-453b-bc86-6caabb3197dc tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acab2a0c4a0e48909317791a3de85b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abe012ba65845329098e0e06c54b9c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:13:16.958748 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-4c03864c-81ef-453b-bc86-6caabb3197dc tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "GET /compute/v2.1/servers/ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc" status: 200 len: 1673 microversion: 2.1 time: 0.138139 Jan 28 02:13:16.959316 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 505/1055] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:13:16 2022] GET /compute/v2.1/servers/ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc => generated 1673 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:13:17.230709 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-c0a91cdb-143a-48ed-997e-afeb9aa7ca76 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:13:17.231303 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-c0a91cdb-143a-48ed-997e-afeb9aa7ca76 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] [instance: 9b886ef6-6c08-4ed8-9d10-35c49c2c6382] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:13:17.238203 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-c0a91cdb-143a-48ed-997e-afeb9aa7ca76 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:13:17.238643 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-c0a91cdb-143a-48ed-997e-afeb9aa7ca76 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:13:17.239393 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-c0a91cdb-143a-48ed-997e-afeb9aa7ca76 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:13:17.239825 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-c0a91cdb-143a-48ed-997e-afeb9aa7ca76 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:13:17.362446 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-c0a91cdb-143a-48ed-997e-afeb9aa7ca76 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5c39b83f31473696c9b249ab49d780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55dde8892fa47bd9941bb1ce9aa3673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:13:17.369526 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-c0a91cdb-143a-48ed-997e-afeb9aa7ca76 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] 10.222.0.79 "GET /compute/v2.1/servers/9b886ef6-6c08-4ed8-9d10-35c49c2c6382" status: 200 len: 1575 microversion: 2.1 time: 0.142487 Jan 28 02:13:17.370086 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 551/1056] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:13:17 2022] GET /compute/v2.1/servers/9b886ef6-6c08-4ed8-9d10-35c49c2c6382 => generated 1575 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:13:17.976457 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-0ea2b144-8412-422f-815c-9ac01d35012d tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:13:17.977051 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-0ea2b144-8412-422f-815c-9ac01d35012d tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:13:17.982699 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-0ea2b144-8412-422f-815c-9ac01d35012d tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:13:17.983141 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-0ea2b144-8412-422f-815c-9ac01d35012d tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:13:17.983894 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-0ea2b144-8412-422f-815c-9ac01d35012d tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:13:17.984356 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-0ea2b144-8412-422f-815c-9ac01d35012d tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:13:18.180469 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-0ea2b144-8412-422f-815c-9ac01d35012d tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acab2a0c4a0e48909317791a3de85b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abe012ba65845329098e0e06c54b9c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:13:18.187887 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-0ea2b144-8412-422f-815c-9ac01d35012d tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "GET /compute/v2.1/servers/ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc" status: 200 len: 1673 microversion: 2.1 time: 0.215027 Jan 28 02:13:18.188611 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 506/1057] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:13:17 2022] GET /compute/v2.1/servers/ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc => generated 1673 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:13:18.386234 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-b9d7c79c-08e6-4bfd-8b6a-4c942b4aed86 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:13:18.388434 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-b9d7c79c-08e6-4bfd-8b6a-4c942b4aed86 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] [instance: 9b886ef6-6c08-4ed8-9d10-35c49c2c6382] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:13:18.392622 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-b9d7c79c-08e6-4bfd-8b6a-4c942b4aed86 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:13:18.393135 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-b9d7c79c-08e6-4bfd-8b6a-4c942b4aed86 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:13:18.394164 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-b9d7c79c-08e6-4bfd-8b6a-4c942b4aed86 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:13:18.394345 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-b9d7c79c-08e6-4bfd-8b6a-4c942b4aed86 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:13:18.576710 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-b9d7c79c-08e6-4bfd-8b6a-4c942b4aed86 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5c39b83f31473696c9b249ab49d780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55dde8892fa47bd9941bb1ce9aa3673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:13:18.584993 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-b9d7c79c-08e6-4bfd-8b6a-4c942b4aed86 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] 10.222.0.79 "GET /compute/v2.1/servers/9b886ef6-6c08-4ed8-9d10-35c49c2c6382" status: 200 len: 1575 microversion: 2.1 time: 0.202451 Jan 28 02:13:18.585556 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 552/1058] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:13:18 2022] GET /compute/v2.1/servers/9b886ef6-6c08-4ed8-9d10-35c49c2c6382 => generated 1575 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:13:18.958409 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [req-c382cd8a-a46f-43e3-b268-df7f9b3b53d2 req-112ce2bf-810e-4f28-be6d-2d4dcb2da79a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc", "name": "network-vif-deleted", "tag": "3247d8ae-933f-49e6-9365-3da79500309f"}]} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:13:18.960090 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:13:18.960090 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: warnings.warn(msg) Jan 28 02:13:18.966846 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-c382cd8a-a46f-43e3-b268-df7f9b3b53d2 req-112ce2bf-810e-4f28-be6d-2d4dcb2da79a service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:13:18.977145 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-c382cd8a-a46f-43e3-b268-df7f9b3b53d2 req-112ce2bf-810e-4f28-be6d-2d4dcb2da79a service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:13:18.979274 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.compute.server_external_events [req-c382cd8a-a46f-43e3-b268-df7f9b3b53d2 req-112ce2bf-810e-4f28-be6d-2d4dcb2da79a service nova] Creating event network-vif-deleted:3247d8ae-933f-49e6-9365-3da79500309f for instance ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc on hv-cinder-82497 Jan 28 02:13:18.984240 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [req-c382cd8a-a46f-43e3-b268-df7f9b3b53d2 req-112ce2bf-810e-4f28-be6d-2d4dcb2da79a service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030472 Jan 28 02:13:18.984822 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 507/1059] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Jan 28 02:13:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:13:19.214572 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-9c036f5b-9d6a-48a7-8650-f034b7e63795 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:13:19.215288 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-9c036f5b-9d6a-48a7-8650-f034b7e63795 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:13:19.221102 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-9c036f5b-9d6a-48a7-8650-f034b7e63795 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:13:19.222803 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-9c036f5b-9d6a-48a7-8650-f034b7e63795 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:13:19.222803 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-9c036f5b-9d6a-48a7-8650-f034b7e63795 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:13:19.223180 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-9c036f5b-9d6a-48a7-8650-f034b7e63795 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:13:19.286237 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-9c036f5b-9d6a-48a7-8650-f034b7e63795 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acab2a0c4a0e48909317791a3de85b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abe012ba65845329098e0e06c54b9c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:13:19.293794 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-9c036f5b-9d6a-48a7-8650-f034b7e63795 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "GET /compute/v2.1/servers/ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc" status: 200 len: 1322 microversion: 2.1 time: 0.082916 Jan 28 02:13:19.297662 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 553/1060] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:13:19 2022] GET /compute/v2.1/servers/ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc => generated 1322 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:13:19.602948 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-4c517989-a2c2-44da-b2bf-2738fd8e321f tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:13:19.603773 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-4c517989-a2c2-44da-b2bf-2738fd8e321f tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] [instance: 9b886ef6-6c08-4ed8-9d10-35c49c2c6382] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:13:19.610393 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-4c517989-a2c2-44da-b2bf-2738fd8e321f tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:13:19.610836 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-4c517989-a2c2-44da-b2bf-2738fd8e321f tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:13:19.611617 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-4c517989-a2c2-44da-b2bf-2738fd8e321f tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:13:19.612628 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-4c517989-a2c2-44da-b2bf-2738fd8e321f tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:13:20.040946 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-4c517989-a2c2-44da-b2bf-2738fd8e321f tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5c39b83f31473696c9b249ab49d780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55dde8892fa47bd9941bb1ce9aa3673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:13:20.055186 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-4c517989-a2c2-44da-b2bf-2738fd8e321f tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] 10.222.0.79 "GET /compute/v2.1/servers/9b886ef6-6c08-4ed8-9d10-35c49c2c6382" status: 200 len: 1575 microversion: 2.1 time: 0.456155 Jan 28 02:13:20.056249 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 508/1061] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:13:19 2022] GET /compute/v2.1/servers/9b886ef6-6c08-4ed8-9d10-35c49c2c6382 => generated 1575 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:13:20.310626 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-f9546b4a-74c9-49ab-be41-cfcb799af4d1 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:13:20.311230 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-f9546b4a-74c9-49ab-be41-cfcb799af4d1 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:13:20.318285 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-f9546b4a-74c9-49ab-be41-cfcb799af4d1 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:13:20.318736 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-f9546b4a-74c9-49ab-be41-cfcb799af4d1 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:13:20.319504 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-f9546b4a-74c9-49ab-be41-cfcb799af4d1 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:13:20.319932 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-f9546b4a-74c9-49ab-be41-cfcb799af4d1 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:13:20.336985 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.wsgi [None req-f9546b4a-74c9-49ab-be41-cfcb799af4d1 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] HTTP exception thrown: Instance ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc could not be found. Jan 28 02:13:20.337585 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-f9546b4a-74c9-49ab-be41-cfcb799af4d1 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Returning 404 to user: Instance ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc could not be found. {{(pid=116374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 02:13:20.339705 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-f9546b4a-74c9-49ab-be41-cfcb799af4d1 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "GET /compute/v2.1/servers/ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc" status: 404 len: 111 microversion: 2.1 time: 0.032732 Jan 28 02:13:20.341168 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 554/1062] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:13:20 2022] GET /compute/v2.1/servers/ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 02:13:20.350974 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-58cfcab5-d8b9-4a67-a45d-2db922f3f41e tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Calling method '.version_select at 0x7f8381621d30>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:13:20.428658 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-58cfcab5-d8b9-4a67-a45d-2db922f3f41e tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-903375684" status: 202 len: 0 microversion: 2.1 time: 0.082651 Jan 28 02:13:20.429260 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 509/1063] 10.222.0.79 () {58 vars in 1217 bytes} [Fri Jan 28 02:13:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-903375684 => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 28 02:13:21.072673 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-48b63305-3066-4794-be1c-c3722a7e3760 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:13:21.073432 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-48b63305-3066-4794-be1c-c3722a7e3760 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] [instance: 9b886ef6-6c08-4ed8-9d10-35c49c2c6382] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:13:21.080004 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-48b63305-3066-4794-be1c-c3722a7e3760 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:13:21.080642 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-48b63305-3066-4794-be1c-c3722a7e3760 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:13:21.081497 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-48b63305-3066-4794-be1c-c3722a7e3760 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:13:21.081919 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-48b63305-3066-4794-be1c-c3722a7e3760 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:13:21.212327 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-48b63305-3066-4794-be1c-c3722a7e3760 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5c39b83f31473696c9b249ab49d780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55dde8892fa47bd9941bb1ce9aa3673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:13:21.220255 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-48b63305-3066-4794-be1c-c3722a7e3760 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] 10.222.0.79 "GET /compute/v2.1/servers/9b886ef6-6c08-4ed8-9d10-35c49c2c6382" status: 200 len: 1575 microversion: 2.1 time: 0.151203 Jan 28 02:13:21.220818 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 555/1064] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:13:21 2022] GET /compute/v2.1/servers/9b886ef6-6c08-4ed8-9d10-35c49c2c6382 => generated 1575 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:13:21.903760 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [req-26628b79-f223-42e0-ac17-81d2b3e17894 req-f4987b8c-dbf7-4aed-bec8-2cb7086f3600 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b886ef6-6c08-4ed8-9d10-35c49c2c6382", "name": "network-vif-plugged", "status": "completed", "tag": "7b4575d4-25de-48a0-8c88-24340312c99a"}]} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:13:21.911550 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:13:21.911550 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: warnings.warn(msg) Jan 28 02:13:21.912486 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-26628b79-f223-42e0-ac17-81d2b3e17894 req-f4987b8c-dbf7-4aed-bec8-2cb7086f3600 service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:13:21.912923 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-26628b79-f223-42e0-ac17-81d2b3e17894 req-f4987b8c-dbf7-4aed-bec8-2cb7086f3600 service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:13:21.923381 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.compute.server_external_events [req-26628b79-f223-42e0-ac17-81d2b3e17894 req-f4987b8c-dbf7-4aed-bec8-2cb7086f3600 service nova] Creating event network-vif-plugged:7b4575d4-25de-48a0-8c88-24340312c99a for instance 9b886ef6-6c08-4ed8-9d10-35c49c2c6382 on hv-cinder-82497 Jan 28 02:13:21.928954 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [req-26628b79-f223-42e0-ac17-81d2b3e17894 req-f4987b8c-dbf7-4aed-bec8-2cb7086f3600 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028820 Jan 28 02:13:21.929486 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 510/1065] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Jan 28 02:13:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:13:22.238307 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-cdfcbe44-5fdf-4061-b6eb-95c536c92eac tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:13:22.239152 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-cdfcbe44-5fdf-4061-b6eb-95c536c92eac tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] [instance: 9b886ef6-6c08-4ed8-9d10-35c49c2c6382] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:13:22.245203 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-cdfcbe44-5fdf-4061-b6eb-95c536c92eac tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:13:22.245639 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-cdfcbe44-5fdf-4061-b6eb-95c536c92eac tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:13:22.246400 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-cdfcbe44-5fdf-4061-b6eb-95c536c92eac tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:13:22.246880 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-cdfcbe44-5fdf-4061-b6eb-95c536c92eac tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:13:22.410968 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-cdfcbe44-5fdf-4061-b6eb-95c536c92eac tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5c39b83f31473696c9b249ab49d780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55dde8892fa47bd9941bb1ce9aa3673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:13:22.418175 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-cdfcbe44-5fdf-4061-b6eb-95c536c92eac tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] 10.222.0.79 "GET /compute/v2.1/servers/9b886ef6-6c08-4ed8-9d10-35c49c2c6382" status: 200 len: 1575 microversion: 2.1 time: 0.185228 Jan 28 02:13:22.418766 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 556/1066] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:13:22 2022] GET /compute/v2.1/servers/9b886ef6-6c08-4ed8-9d10-35c49c2c6382 => generated 1575 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:13:23.436921 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-4a531ebf-7255-4081-bcf8-473b986efa9b tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:13:23.437602 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-4a531ebf-7255-4081-bcf8-473b986efa9b tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] [instance: 9b886ef6-6c08-4ed8-9d10-35c49c2c6382] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:13:23.443661 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-4a531ebf-7255-4081-bcf8-473b986efa9b tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:13:23.444158 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-4a531ebf-7255-4081-bcf8-473b986efa9b tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:13:23.444923 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-4a531ebf-7255-4081-bcf8-473b986efa9b tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:13:23.445353 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-4a531ebf-7255-4081-bcf8-473b986efa9b tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:13:23.567684 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-4a531ebf-7255-4081-bcf8-473b986efa9b tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5c39b83f31473696c9b249ab49d780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55dde8892fa47bd9941bb1ce9aa3673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:13:23.575147 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-4a531ebf-7255-4081-bcf8-473b986efa9b tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] 10.222.0.79 "GET /compute/v2.1/servers/9b886ef6-6c08-4ed8-9d10-35c49c2c6382" status: 200 len: 1575 microversion: 2.1 time: 0.142583 Jan 28 02:13:23.582706 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 511/1067] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:13:23 2022] GET /compute/v2.1/servers/9b886ef6-6c08-4ed8-9d10-35c49c2c6382 => generated 1575 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:13:24.125205 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-08c8ee0a-f47c-481a-bf6e-99b2d2f639f5 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:13:24.125695 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-08c8ee0a-f47c-481a-bf6e-99b2d2f639f5 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:13:24.131956 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-08c8ee0a-f47c-481a-bf6e-99b2d2f639f5 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:13:24.132425 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-08c8ee0a-f47c-481a-bf6e-99b2d2f639f5 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:13:24.133233 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-08c8ee0a-f47c-481a-bf6e-99b2d2f639f5 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:13:24.133668 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-08c8ee0a-f47c-481a-bf6e-99b2d2f639f5 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:13:24.147102 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.wsgi [None req-08c8ee0a-f47c-481a-bf6e-99b2d2f639f5 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] HTTP exception thrown: Instance ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc could not be found. Jan 28 02:13:24.147690 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-08c8ee0a-f47c-481a-bf6e-99b2d2f639f5 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Returning 404 to user: Instance ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc could not be found. {{(pid=116374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 02:13:24.148535 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-08c8ee0a-f47c-481a-bf6e-99b2d2f639f5 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "DELETE /compute/v2.1/servers/ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc" status: 404 len: 111 microversion: 2.1 time: 0.027208 Jan 28 02:13:24.149066 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 557/1068] 10.222.0.79 () {58 vars in 1238 bytes} [Fri Jan 28 02:13:24 2022] DELETE /compute/v2.1/servers/ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 02:13:24.156870 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-20ccb939-cc86-433f-80bc-17960b1e3a14 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:13:24.157517 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-20ccb939-cc86-433f-80bc-17960b1e3a14 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:13:24.166287 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-20ccb939-cc86-433f-80bc-17960b1e3a14 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:13:24.166860 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-20ccb939-cc86-433f-80bc-17960b1e3a14 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:13:24.167637 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-20ccb939-cc86-433f-80bc-17960b1e3a14 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:13:24.168100 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-20ccb939-cc86-433f-80bc-17960b1e3a14 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:13:24.181750 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.wsgi [None req-20ccb939-cc86-433f-80bc-17960b1e3a14 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] HTTP exception thrown: Instance ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc could not be found. Jan 28 02:13:24.190525 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-20ccb939-cc86-433f-80bc-17960b1e3a14 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Returning 404 to user: Instance ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc could not be found. {{(pid=116375) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 02:13:24.190525 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-20ccb939-cc86-433f-80bc-17960b1e3a14 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "GET /compute/v2.1/servers/ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc" status: 404 len: 111 microversion: 2.1 time: 0.030174 Jan 28 02:13:24.190525 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 512/1069] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:13:24 2022] GET /compute/v2.1/servers/ddc55fba-5ce9-4aa9-b228-1bcb5d6941fc => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 02:13:24.593263 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-3ca6d5f0-eb3e-4fb0-851f-29ee7a901d30 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:13:24.593867 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-3ca6d5f0-eb3e-4fb0-851f-29ee7a901d30 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] [instance: 9b886ef6-6c08-4ed8-9d10-35c49c2c6382] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:13:24.600457 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-3ca6d5f0-eb3e-4fb0-851f-29ee7a901d30 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:13:24.600902 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-3ca6d5f0-eb3e-4fb0-851f-29ee7a901d30 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:13:24.601670 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-3ca6d5f0-eb3e-4fb0-851f-29ee7a901d30 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:13:24.602102 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-3ca6d5f0-eb3e-4fb0-851f-29ee7a901d30 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:13:24.718611 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-3ca6d5f0-eb3e-4fb0-851f-29ee7a901d30 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5c39b83f31473696c9b249ab49d780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55dde8892fa47bd9941bb1ce9aa3673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:13:24.727169 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-3ca6d5f0-eb3e-4fb0-851f-29ee7a901d30 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] 10.222.0.79 "GET /compute/v2.1/servers/9b886ef6-6c08-4ed8-9d10-35c49c2c6382" status: 200 len: 1562 microversion: 2.1 time: 0.137582 Jan 28 02:13:24.727754 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 558/1070] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:13:24 2022] GET /compute/v2.1/servers/9b886ef6-6c08-4ed8-9d10-35c49c2c6382 => generated 1562 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:13:25.418506 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-d6c82269-b132-4a31-bb19-72466cd66c08 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:13:25.418983 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-d6c82269-b132-4a31-bb19-72466cd66c08 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: d5f49055-da38-486c-9f10-1658c64d46f5] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:13:25.424864 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-d6c82269-b132-4a31-bb19-72466cd66c08 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:13:25.425310 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-d6c82269-b132-4a31-bb19-72466cd66c08 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:13:25.426074 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-d6c82269-b132-4a31-bb19-72466cd66c08 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:13:25.426505 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-d6c82269-b132-4a31-bb19-72466cd66c08 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:13:25.439647 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.wsgi [None req-d6c82269-b132-4a31-bb19-72466cd66c08 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] HTTP exception thrown: Instance d5f49055-da38-486c-9f10-1658c64d46f5 could not be found. Jan 28 02:13:25.440253 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-d6c82269-b132-4a31-bb19-72466cd66c08 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Returning 404 to user: Instance d5f49055-da38-486c-9f10-1658c64d46f5 could not be found. {{(pid=116375) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 02:13:25.441064 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-d6c82269-b132-4a31-bb19-72466cd66c08 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "DELETE /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5" status: 404 len: 111 microversion: 2.1 time: 0.026275 Jan 28 02:13:25.441619 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 513/1071] 10.222.0.79 () {58 vars in 1238 bytes} [Fri Jan 28 02:13:25 2022] DELETE /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 02:13:25.449839 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-499d88fd-5152-43d2-b4a9-c0e05c9ac0f4 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:13:25.450440 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-499d88fd-5152-43d2-b4a9-c0e05c9ac0f4 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] [instance: d5f49055-da38-486c-9f10-1658c64d46f5] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:13:25.456162 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-499d88fd-5152-43d2-b4a9-c0e05c9ac0f4 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:13:25.456607 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-499d88fd-5152-43d2-b4a9-c0e05c9ac0f4 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:13:25.457364 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-499d88fd-5152-43d2-b4a9-c0e05c9ac0f4 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:13:25.457839 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-499d88fd-5152-43d2-b4a9-c0e05c9ac0f4 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:13:25.471256 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.wsgi [None req-499d88fd-5152-43d2-b4a9-c0e05c9ac0f4 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] HTTP exception thrown: Instance d5f49055-da38-486c-9f10-1658c64d46f5 could not be found. Jan 28 02:13:25.472123 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-499d88fd-5152-43d2-b4a9-c0e05c9ac0f4 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] Returning 404 to user: Instance d5f49055-da38-486c-9f10-1658c64d46f5 could not be found. {{(pid=116374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 02:13:25.472923 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-499d88fd-5152-43d2-b4a9-c0e05c9ac0f4 tempest-AttachVolumeTestJSON-909277733 tempest-AttachVolumeTestJSON-909277733-project] 10.222.0.79 "GET /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5" status: 404 len: 111 microversion: 2.1 time: 0.026731 Jan 28 02:13:25.473439 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 559/1072] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:13:25 2022] GET /compute/v2.1/servers/d5f49055-da38-486c-9f10-1658c64d46f5 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 02:13:32.678583 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-fcaf80a6-d6ba-45ac-9a99-915d9e110f16 tempest-VolumesTestJSON-1696741344 tempest-VolumesTestJSON-1696741344-project] Calling method '.version_select at 0x7f838163aa60>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:13:32.732593 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-fcaf80a6-d6ba-45ac-9a99-915d9e110f16 tempest-VolumesTestJSON-1696741344 tempest-VolumesTestJSON-1696741344-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/40bb3cda-c961-4368-89b6-51358c4257db" status: 200 len: 351 microversion: 2.1 time: 0.057682 Jan 28 02:13:32.733149 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 514/1073] 10.222.0.79 () {58 vars in 1244 bytes} [Fri Jan 28 02:13:32 2022] GET /compute/v2.1/os-volumes/40bb3cda-c961-4368-89b6-51358c4257db => generated 351 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:13:34.430901 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-a7a95edc-4e5f-4aad-8ba1-6c530f3eeac3 tempest-VolumesTestJSON-1696741344 tempest-VolumesTestJSON-1696741344-project] Calling method '.version_select at 0x7f837c400700>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:13:34.481698 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-a7a95edc-4e5f-4aad-8ba1-6c530f3eeac3 tempest-VolumesTestJSON-1696741344 tempest-VolumesTestJSON-1696741344-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/e530068a-0bff-4cd0-8ef5-a6d91b153a86" status: 200 len: 351 microversion: 2.1 time: 0.055192 Jan 28 02:13:34.482395 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 560/1074] 10.222.0.79 () {58 vars in 1244 bytes} [Fri Jan 28 02:13:34 2022] GET /compute/v2.1/os-volumes/e530068a-0bff-4cd0-8ef5-a6d91b153a86 => generated 351 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:13:35.853722 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-79a9fbd3-f08b-4142-b205-04e231275d4e tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:13:35.854678 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-79a9fbd3-f08b-4142-b205-04e231275d4e tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: c3ea23ca-a790-4f52-ad85-dcac640a8695] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:13:35.860701 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-79a9fbd3-f08b-4142-b205-04e231275d4e tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:13:35.861160 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-79a9fbd3-f08b-4142-b205-04e231275d4e tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:13:35.861914 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-79a9fbd3-f08b-4142-b205-04e231275d4e tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:13:35.862336 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-79a9fbd3-f08b-4142-b205-04e231275d4e tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:13:35.891720 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-79a9fbd3-f08b-4142-b205-04e231275d4e tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.042310 Jan 28 02:13:35.892314 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 515/1075] 10.222.0.79 () {60 vars in 1342 bytes} [Fri Jan 28 02:13:35 2022] GET /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:13:35.954628 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-389f8419-56d0-4b03-8042-b72f49323a6d tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:13:35.955251 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-389f8419-56d0-4b03-8042-b72f49323a6d tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: c3ea23ca-a790-4f52-ad85-dcac640a8695] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:13:35.960917 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-389f8419-56d0-4b03-8042-b72f49323a6d tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:13:35.963575 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-389f8419-56d0-4b03-8042-b72f49323a6d tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:13:35.963575 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-389f8419-56d0-4b03-8042-b72f49323a6d tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:13:35.963575 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-389f8419-56d0-4b03-8042-b72f49323a6d tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:13:35.987090 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-389f8419-56d0-4b03-8042-b72f49323a6d tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: c3ea23ca-a790-4f52-ad85-dcac640a8695] Going to try to terminate instance {{(pid=116374) delete /opt/stack/nova/nova/compute/api.py:2612}} Jan 28 02:13:36.126759 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-f610150e-aa07-4a9f-b7fa-cec94b4c7612 tempest-VolumesTestJSON-1696741344 tempest-VolumesTestJSON-1696741344-project] Calling method '.version_select at 0x7f8381621d30>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:13:36.177379 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-f610150e-aa07-4a9f-b7fa-cec94b4c7612 tempest-VolumesTestJSON-1696741344 tempest-VolumesTestJSON-1696741344-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/29f122ff-f447-4d5c-8c4a-3581c13066db" status: 200 len: 350 microversion: 2.1 time: 0.054099 Jan 28 02:13:36.177947 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 516/1076] 10.222.0.79 () {58 vars in 1244 bytes} [Fri Jan 28 02:13:36 2022] GET /compute/v2.1/os-volumes/29f122ff-f447-4d5c-8c4a-3581c13066db => generated 350 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 02:13:36.189329 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-cd9a0b45-e867-4ef8-9a7a-eabfca9e185f tempest-VolumesTestJSON-1696741344 tempest-VolumesTestJSON-1696741344-project] Calling method '.version_select at 0x7f838163faf0>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:13:36.275400 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-cd9a0b45-e867-4ef8-9a7a-eabfca9e185f tempest-VolumesTestJSON-1696741344 tempest-VolumesTestJSON-1696741344-project] 10.222.0.79 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.089356 Jan 28 02:13:36.276005 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 517/1077] 10.222.0.79 () {58 vars in 1133 bytes} [Fri Jan 28 02:13:36 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:13:36.287951 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-d4e6de66-dfac-4d83-b13d-cdd18471a30e tempest-VolumesTestJSON-1696741344 tempest-VolumesTestJSON-1696741344-project] Calling method '.version_select at 0x7f836fd089d0>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:13:36.300728 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-389f8419-56d0-4b03-8042-b72f49323a6d tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "DELETE /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695" status: 204 len: 0 microversion: 2.20 time: 0.349429 Jan 28 02:13:36.301309 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 561/1078] 10.222.0.79 () {60 vars in 1279 bytes} [Fri Jan 28 02:13:35 2022] DELETE /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 28 02:13:36.310481 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-96c2319e-1cdc-47c7-a193-b55c53364851 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:13:36.311219 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-96c2319e-1cdc-47c7-a193-b55c53364851 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: c3ea23ca-a790-4f52-ad85-dcac640a8695] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:13:36.317240 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-96c2319e-1cdc-47c7-a193-b55c53364851 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:13:36.317688 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-96c2319e-1cdc-47c7-a193-b55c53364851 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:13:36.318475 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-96c2319e-1cdc-47c7-a193-b55c53364851 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:13:36.318909 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-96c2319e-1cdc-47c7-a193-b55c53364851 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:13:36.375115 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-d4e6de66-dfac-4d83-b13d-cdd18471a30e tempest-VolumesTestJSON-1696741344 tempest-VolumesTestJSON-1696741344-project] 10.222.0.79 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.090673 Jan 28 02:13:36.375684 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 518/1079] 10.222.0.79 () {58 vars in 1148 bytes} [Fri Jan 28 02:13:36 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 02:13:36.387161 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-85e29ae6-05ce-441e-86a1-d8f3176468db tempest-VolumesTestJSON-1696741344 tempest-VolumesTestJSON-1696741344-project] Calling method '.version_select at 0x7f836fd298b0>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:13:36.443304 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-96c2319e-1cdc-47c7-a193-b55c53364851 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:13:36.451899 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-96c2319e-1cdc-47c7-a193-b55c53364851 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:13:36.453445 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-96c2319e-1cdc-47c7-a193-b55c53364851 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:13:36.454619 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-96c2319e-1cdc-47c7-a193-b55c53364851 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695" status: 200 len: 1721 microversion: 2.20 time: 0.148237 Jan 28 02:13:36.455179 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 562/1080] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:13:36 2022] GET /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695 => generated 1721 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 02:13:36.470024 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-85e29ae6-05ce-441e-86a1-d8f3176468db tempest-VolumesTestJSON-1696741344 tempest-VolumesTestJSON-1696741344-project] 10.222.0.79 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.086262 Jan 28 02:13:36.470683 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 519/1081] 10.222.0.79 () {58 vars in 1133 bytes} [Fri Jan 28 02:13:36 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:13:36.483058 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-9e95bf58-703a-47c7-af15-4be7db03d021 tempest-VolumesTestJSON-1696741344 tempest-VolumesTestJSON-1696741344-project] Calling method '.version_select at 0x7f837c3b3040>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:13:36.564171 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-9e95bf58-703a-47c7-af15-4be7db03d021 tempest-VolumesTestJSON-1696741344 tempest-VolumesTestJSON-1696741344-project] 10.222.0.79 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.084661 Jan 28 02:13:36.564740 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 563/1082] 10.222.0.79 () {58 vars in 1166 bytes} [Fri Jan 28 02:13:36 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:13:36.576426 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-d8f74903-3c9c-4cee-82f8-631e1eba35b0 tempest-VolumesTestJSON-1696741344 tempest-VolumesTestJSON-1696741344-project] Calling method '.version_select at 0x7f83815d60d0>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:13:36.656584 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-d8f74903-3c9c-4cee-82f8-631e1eba35b0 tempest-VolumesTestJSON-1696741344 tempest-VolumesTestJSON-1696741344-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.083669 Jan 28 02:13:36.657154 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 520/1083] 10.222.0.79 () {58 vars in 1169 bytes} [Fri Jan 28 02:13:36 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:13:36.669875 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-edf02024-2817-4b98-9178-ed7c7f30537a tempest-VolumesTestJSON-1696741344 tempest-VolumesTestJSON-1696741344-project] Calling method '.version_select at 0x7f837c400790>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:13:36.753205 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-edf02024-2817-4b98-9178-ed7c7f30537a tempest-VolumesTestJSON-1696741344 tempest-VolumesTestJSON-1696741344-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.086858 Jan 28 02:13:36.753767 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 564/1084] 10.222.0.79 () {58 vars in 1154 bytes} [Fri Jan 28 02:13:36 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:13:36.765531 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-1bad7123-d343-4e1f-867c-c9ac3003d5fa tempest-VolumesTestJSON-1696741344 tempest-VolumesTestJSON-1696741344-project] Calling method '.version_select at 0x7f838163aa60>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:13:36.845352 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-1bad7123-d343-4e1f-867c-c9ac3003d5fa tempest-VolumesTestJSON-1696741344 tempest-VolumesTestJSON-1696741344-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.083422 Jan 28 02:13:36.845921 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 521/1085] 10.222.0.79 () {58 vars in 1187 bytes} [Fri Jan 28 02:13:36 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:13:36.857780 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-1346fdb7-ac99-4968-8b3e-75ff283f1272 tempest-VolumesTestJSON-1696741344 tempest-VolumesTestJSON-1696741344-project] Calling method '.version_select at 0x7f837c37a670>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:13:36.941786 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-1346fdb7-ac99-4968-8b3e-75ff283f1272 tempest-VolumesTestJSON-1696741344 tempest-VolumesTestJSON-1696741344-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.087422 Jan 28 02:13:36.942352 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 565/1086] 10.222.0.79 () {58 vars in 1154 bytes} [Fri Jan 28 02:13:36 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:13:37.473981 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-33434de4-7923-42a6-950f-43a7c649116b tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:13:37.474523 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-33434de4-7923-42a6-950f-43a7c649116b tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: c3ea23ca-a790-4f52-ad85-dcac640a8695] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:13:37.481199 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-33434de4-7923-42a6-950f-43a7c649116b tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:13:37.481660 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-33434de4-7923-42a6-950f-43a7c649116b tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:13:37.482494 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-33434de4-7923-42a6-950f-43a7c649116b tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:13:37.482934 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-33434de4-7923-42a6-950f-43a7c649116b tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:13:37.602992 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-33434de4-7923-42a6-950f-43a7c649116b tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:13:37.610609 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-33434de4-7923-42a6-950f-43a7c649116b tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:13:37.612371 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-33434de4-7923-42a6-950f-43a7c649116b tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:13:37.613601 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-33434de4-7923-42a6-950f-43a7c649116b tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695" status: 200 len: 1721 microversion: 2.20 time: 0.143727 Jan 28 02:13:37.614147 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 522/1087] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:13:37 2022] GET /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695 => generated 1721 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:13:38.632960 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-2eec3df1-557d-479f-9d08-cf6a1197175e tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:13:38.633788 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-2eec3df1-557d-479f-9d08-cf6a1197175e tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: c3ea23ca-a790-4f52-ad85-dcac640a8695] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:13:38.640051 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-2eec3df1-557d-479f-9d08-cf6a1197175e tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:13:38.640499 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-2eec3df1-557d-479f-9d08-cf6a1197175e tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:13:38.641279 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-2eec3df1-557d-479f-9d08-cf6a1197175e tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:13:38.641703 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-2eec3df1-557d-479f-9d08-cf6a1197175e tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:13:38.795392 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-2eec3df1-557d-479f-9d08-cf6a1197175e tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:13:38.804541 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-2eec3df1-557d-479f-9d08-cf6a1197175e tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:13:38.806402 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-2eec3df1-557d-479f-9d08-cf6a1197175e tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:13:38.807720 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-2eec3df1-557d-479f-9d08-cf6a1197175e tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695" status: 200 len: 1721 microversion: 2.20 time: 0.179582 Jan 28 02:13:38.808310 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 566/1088] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:13:38 2022] GET /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695 => generated 1721 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 02:13:39.159496 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [req-4b36e76f-5246-42bf-a87b-05c56ba7f313 req-60c0e068-21cb-42f8-b03a-5cea1d32eab7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3ea23ca-a790-4f52-ad85-dcac640a8695", "name": "network-vif-deleted", "tag": "a5ba13e6-3134-4ccb-b060-70df55025709"}]} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:13:39.161113 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:13:39.161113 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: warnings.warn(msg) Jan 28 02:13:39.172589 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-4b36e76f-5246-42bf-a87b-05c56ba7f313 req-60c0e068-21cb-42f8-b03a-5cea1d32eab7 service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:13:39.173040 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-4b36e76f-5246-42bf-a87b-05c56ba7f313 req-60c0e068-21cb-42f8-b03a-5cea1d32eab7 service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:13:39.186791 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.compute.server_external_events [req-4b36e76f-5246-42bf-a87b-05c56ba7f313 req-60c0e068-21cb-42f8-b03a-5cea1d32eab7 service nova] Creating event network-vif-deleted:a5ba13e6-3134-4ccb-b060-70df55025709 for instance c3ea23ca-a790-4f52-ad85-dcac640a8695 on hv-cinder-82497 Jan 28 02:13:39.197057 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [req-4b36e76f-5246-42bf-a87b-05c56ba7f313 req-60c0e068-21cb-42f8-b03a-5cea1d32eab7 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038746 Jan 28 02:13:39.198346 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 523/1089] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Jan 28 02:13:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:13:39.825699 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-5d4e361a-81b4-41d8-9e67-0ee5958e0b31 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:13:39.826295 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-5d4e361a-81b4-41d8-9e67-0ee5958e0b31 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: c3ea23ca-a790-4f52-ad85-dcac640a8695] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:13:39.832105 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-5d4e361a-81b4-41d8-9e67-0ee5958e0b31 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:13:39.832552 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-5d4e361a-81b4-41d8-9e67-0ee5958e0b31 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:13:39.833321 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-5d4e361a-81b4-41d8-9e67-0ee5958e0b31 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:13:39.833743 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-5d4e361a-81b4-41d8-9e67-0ee5958e0b31 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:13:39.867379 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-5d4e361a-81b4-41d8-9e67-0ee5958e0b31 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:13:39.867818 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-5d4e361a-81b4-41d8-9e67-0ee5958e0b31 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:13:39.868356 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.objects.instance [None req-5d4e361a-81b4-41d8-9e67-0ee5958e0b31 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lazy-loading 'fault' on Instance uuid c3ea23ca-a790-4f52-ad85-dcac640a8695 {{(pid=116374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jan 28 02:13:39.926691 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-5d4e361a-81b4-41d8-9e67-0ee5958e0b31 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:13:39.931183 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-5d4e361a-81b4-41d8-9e67-0ee5958e0b31 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:13:39.932958 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-5d4e361a-81b4-41d8-9e67-0ee5958e0b31 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a6e7ef3a7fd145e5ab8726786ba318bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdd27e926a84fa49844fbcca271bb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:13:39.934443 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-5d4e361a-81b4-41d8-9e67-0ee5958e0b31 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695" status: 200 len: 1371 microversion: 2.20 time: 0.112264 Jan 28 02:13:39.935008 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 567/1090] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:13:39 2022] GET /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695 => generated 1371 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 02:13:40.952900 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-2ab3c6e5-2f84-4070-a03f-4ba5db0b1167 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:13:40.953603 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-2ab3c6e5-2f84-4070-a03f-4ba5db0b1167 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: c3ea23ca-a790-4f52-ad85-dcac640a8695] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:13:40.959787 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2ab3c6e5-2f84-4070-a03f-4ba5db0b1167 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:13:40.960258 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2ab3c6e5-2f84-4070-a03f-4ba5db0b1167 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:13:40.961655 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2ab3c6e5-2f84-4070-a03f-4ba5db0b1167 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:13:40.962142 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2ab3c6e5-2f84-4070-a03f-4ba5db0b1167 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:13:40.975861 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.wsgi [None req-2ab3c6e5-2f84-4070-a03f-4ba5db0b1167 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] HTTP exception thrown: Instance c3ea23ca-a790-4f52-ad85-dcac640a8695 could not be found. Jan 28 02:13:40.976581 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-2ab3c6e5-2f84-4070-a03f-4ba5db0b1167 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Returning 404 to user: Instance c3ea23ca-a790-4f52-ad85-dcac640a8695 could not be found. {{(pid=116375) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 02:13:40.977767 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-2ab3c6e5-2f84-4070-a03f-4ba5db0b1167 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695" status: 404 len: 111 microversion: 2.20 time: 0.028995 Jan 28 02:13:40.978340 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 524/1091] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:13:40 2022] GET /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 28 02:13:40.986326 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-b9fa7be5-a1fe-4f35-b434-fae5ead1d66d tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '.version_select at 0x7f837c3f1b80>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:13:41.057834 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-b9fa7be5-a1fe-4f35-b434-fae5ead1d66d tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-308870601" status: 204 len: 0 microversion: 2.20 time: 0.074923 Jan 28 02:13:41.058524 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 568/1092] 10.222.0.79 () {60 vars in 1258 bytes} [Fri Jan 28 02:13:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-308870601 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 28 02:13:43.159441 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-7c135159-7e0b-4f86-9892-a00d01fc8b5d tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:13:43.160078 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-7c135159-7e0b-4f86-9892-a00d01fc8b5d tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: c3ea23ca-a790-4f52-ad85-dcac640a8695] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:13:43.166837 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-7c135159-7e0b-4f86-9892-a00d01fc8b5d tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:13:43.167290 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-7c135159-7e0b-4f86-9892-a00d01fc8b5d tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:13:43.168330 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-7c135159-7e0b-4f86-9892-a00d01fc8b5d tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:13:43.168767 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-7c135159-7e0b-4f86-9892-a00d01fc8b5d tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:13:43.184152 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.wsgi [None req-7c135159-7e0b-4f86-9892-a00d01fc8b5d tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] HTTP exception thrown: Instance c3ea23ca-a790-4f52-ad85-dcac640a8695 could not be found. Jan 28 02:13:43.184752 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-7c135159-7e0b-4f86-9892-a00d01fc8b5d tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Returning 404 to user: Instance c3ea23ca-a790-4f52-ad85-dcac640a8695 could not be found. {{(pid=116375) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 02:13:43.185592 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-7c135159-7e0b-4f86-9892-a00d01fc8b5d tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "DELETE /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695" status: 404 len: 111 microversion: 2.20 time: 0.029937 Jan 28 02:13:43.186152 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 525/1093] 10.222.0.79 () {60 vars in 1279 bytes} [Fri Jan 28 02:13:43 2022] DELETE /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 28 02:13:43.194413 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-77830b18-416e-482e-b7fe-f747a098a673 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:13:43.195070 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-77830b18-416e-482e-b7fe-f747a098a673 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: c3ea23ca-a790-4f52-ad85-dcac640a8695] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:13:43.201647 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-77830b18-416e-482e-b7fe-f747a098a673 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:13:43.202150 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-77830b18-416e-482e-b7fe-f747a098a673 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:13:43.202907 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-77830b18-416e-482e-b7fe-f747a098a673 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:13:43.203389 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-77830b18-416e-482e-b7fe-f747a098a673 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:13:43.218789 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.wsgi [None req-77830b18-416e-482e-b7fe-f747a098a673 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] HTTP exception thrown: Instance c3ea23ca-a790-4f52-ad85-dcac640a8695 could not be found. Jan 28 02:13:43.224176 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-77830b18-416e-482e-b7fe-f747a098a673 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Returning 404 to user: Instance c3ea23ca-a790-4f52-ad85-dcac640a8695 could not be found. {{(pid=116374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 02:13:43.224176 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-77830b18-416e-482e-b7fe-f747a098a673 tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695" status: 404 len: 111 microversion: 2.20 time: 0.029661 Jan 28 02:13:43.224176 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 569/1094] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:13:43 2022] GET /compute/v2.1/servers/c3ea23ca-a790-4f52-ad85-dcac640a8695 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 28 02:13:44.572881 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-ce5f3dab-396c-44ec-bd78-4f3c800ef5cd tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:13:44.573487 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-ce5f3dab-396c-44ec-bd78-4f3c800ef5cd tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:13:44.579217 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ce5f3dab-396c-44ec-bd78-4f3c800ef5cd tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:13:44.579830 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ce5f3dab-396c-44ec-bd78-4f3c800ef5cd tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:13:44.581006 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ce5f3dab-396c-44ec-bd78-4f3c800ef5cd tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:13:44.581141 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ce5f3dab-396c-44ec-bd78-4f3c800ef5cd tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:13:44.595129 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.wsgi [None req-ce5f3dab-396c-44ec-bd78-4f3c800ef5cd tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] HTTP exception thrown: Instance 4f25403b-0399-48d0-86a9-6e5022287c84 could not be found. Jan 28 02:13:44.596596 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-ce5f3dab-396c-44ec-bd78-4f3c800ef5cd tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Returning 404 to user: Instance 4f25403b-0399-48d0-86a9-6e5022287c84 could not be found. {{(pid=116375) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 02:13:44.596722 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-ce5f3dab-396c-44ec-bd78-4f3c800ef5cd tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "DELETE /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84" status: 404 len: 111 microversion: 2.20 time: 0.028210 Jan 28 02:13:44.597447 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 526/1095] 10.222.0.79 () {60 vars in 1279 bytes} [Fri Jan 28 02:13:44 2022] DELETE /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 28 02:13:44.606177 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-789e2fab-14e8-459c-a690-d4ad26ab28ad tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:13:44.606829 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-789e2fab-14e8-459c-a690-d4ad26ab28ad tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] [instance: 4f25403b-0399-48d0-86a9-6e5022287c84] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:13:44.613039 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-789e2fab-14e8-459c-a690-d4ad26ab28ad tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:13:44.613473 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-789e2fab-14e8-459c-a690-d4ad26ab28ad tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:13:44.614246 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-789e2fab-14e8-459c-a690-d4ad26ab28ad tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:13:44.614680 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-789e2fab-14e8-459c-a690-d4ad26ab28ad tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:13:44.629154 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.wsgi [None req-789e2fab-14e8-459c-a690-d4ad26ab28ad tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] HTTP exception thrown: Instance 4f25403b-0399-48d0-86a9-6e5022287c84 could not be found. Jan 28 02:13:44.629851 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-789e2fab-14e8-459c-a690-d4ad26ab28ad tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] Returning 404 to user: Instance 4f25403b-0399-48d0-86a9-6e5022287c84 could not be found. {{(pid=116374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 02:13:44.630680 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-789e2fab-14e8-459c-a690-d4ad26ab28ad tempest-AttachVolumeShelveTestJSON-190760692 tempest-AttachVolumeShelveTestJSON-190760692-project] 10.222.0.79 "GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84" status: 404 len: 111 microversion: 2.20 time: 0.028254 Jan 28 02:13:44.631220 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 570/1096] 10.222.0.79 () {60 vars in 1276 bytes} [Fri Jan 28 02:13:44 2022] GET /compute/v2.1/servers/4f25403b-0399-48d0-86a9-6e5022287c84 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 28 02:14:17.272360 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-5b51e21f-69a2-4a11-bca2-b957cd21ce05 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-440841648", "imageRef": "04805ce8-b0a0-41b2-b614-bfb5b752cc5d", "flavorRef": "452", "networks": [{"uuid": "71599fa5-1b53-41d1-82ec-e6b2105a5144"}]}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:14:17.336725 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.network.neutron [None req-5b51e21f-69a2-4a11-bca2-b957cd21ce05 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] validate_networks() for [('71599fa5-1b53-41d1-82ec-e6b2105a5144', None, None, None, None, None)] {{(pid=116375) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Jan 28 02:14:17.685213 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.virt.hardware [None req-5b51e21f-69a2-4a11-bca2-b957cd21ce05 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Flavor limits 0:0:0 {{(pid=116375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 02:14:17.685733 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.virt.hardware [None req-5b51e21f-69a2-4a11-bca2-b957cd21ce05 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Image limits 0:0:0 {{(pid=116375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 02:14:17.686214 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.virt.hardware [None req-5b51e21f-69a2-4a11-bca2-b957cd21ce05 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Flavor pref 0:0:0 {{(pid=116375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 02:14:17.686622 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.virt.hardware [None req-5b51e21f-69a2-4a11-bca2-b957cd21ce05 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Image pref 0:0:0 {{(pid=116375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 02:14:17.687113 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.virt.hardware [None req-5b51e21f-69a2-4a11-bca2-b957cd21ce05 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 02:14:17.695959 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-5b51e21f-69a2-4a11-bca2-b957cd21ce05 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:17.696447 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-5b51e21f-69a2-4a11-bca2-b957cd21ce05 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:17.697323 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-5b51e21f-69a2-4a11-bca2-b957cd21ce05 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:17.697742 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-5b51e21f-69a2-4a11-bca2-b957cd21ce05 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:17.715004 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.quota [None req-5b51e21f-69a2-4a11-bca2-b957cd21ce05 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Getting quotas for project 42e977ea9e1f45ddbba1e5cfc40616be. Resources: {'ram', 'cores', 'instances'} {{(pid=116375) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 02:14:17.718926 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.quota [None req-5b51e21f-69a2-4a11-bca2-b957cd21ce05 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Getting quotas for user d45e3859fd364a48b40248e2a383121d and project 42e977ea9e1f45ddbba1e5cfc40616be. Resources: {'ram', 'cores', 'instances'} {{(pid=116375) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 02:14:17.731316 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-5b51e21f-69a2-4a11-bca2-b957cd21ce05 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Going to run 1 instances... {{(pid=116375) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 02:14:17.733718 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-5b51e21f-69a2-4a11-bca2-b957cd21ce05 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] [instance: f15bc945-3a06-4b6e-a78c-7f7a4704a9b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='04805ce8-b0a0-41b2-b614-bfb5b752cc5d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116375) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 02:14:17.867670 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-5b51e21f-69a2-4a11-bca2-b957cd21ce05 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.599606 Jan 28 02:14:17.868550 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 527/1097] 10.222.0.79 () {60 vars in 1146 bytes} [Fri Jan 28 02:14:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 601 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 28 02:14:17.878179 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-c3a41ca1-81a7-48b3-96e6-f4cc8b7be77c tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:14:17.878907 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-c3a41ca1-81a7-48b3-96e6-f4cc8b7be77c tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] [instance: f15bc945-3a06-4b6e-a78c-7f7a4704a9b4] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:14:17.931000 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-c3a41ca1-81a7-48b3-96e6-f4cc8b7be77c tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45e3859fd364a48b40248e2a383121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e977ea9e1f45ddbba1e5cfc40616be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:14:17.937481 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-c3a41ca1-81a7-48b3-96e6-f4cc8b7be77c tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] 10.222.0.79 "GET /compute/v2.1/servers/f15bc945-3a06-4b6e-a78c-7f7a4704a9b4" status: 200 len: 1213 microversion: 2.1 time: 0.063013 Jan 28 02:14:17.938033 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 571/1098] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:14:17 2022] GET /compute/v2.1/servers/f15bc945-3a06-4b6e-a78c-7f7a4704a9b4 => generated 1213 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:14:18.954315 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-0aa4577f-8687-4d5d-9c41-7082b567a95a tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:14:18.954934 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-0aa4577f-8687-4d5d-9c41-7082b567a95a tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] [instance: f15bc945-3a06-4b6e-a78c-7f7a4704a9b4] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:14:18.961916 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-0aa4577f-8687-4d5d-9c41-7082b567a95a tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:18.962406 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-0aa4577f-8687-4d5d-9c41-7082b567a95a tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:18.963209 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-0aa4577f-8687-4d5d-9c41-7082b567a95a tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:18.963644 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-0aa4577f-8687-4d5d-9c41-7082b567a95a tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:19.029286 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-0aa4577f-8687-4d5d-9c41-7082b567a95a tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45e3859fd364a48b40248e2a383121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e977ea9e1f45ddbba1e5cfc40616be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:14:19.042100 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-0aa4577f-8687-4d5d-9c41-7082b567a95a tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] 10.222.0.79 "GET /compute/v2.1/servers/f15bc945-3a06-4b6e-a78c-7f7a4704a9b4" status: 200 len: 1217 microversion: 2.1 time: 0.091131 Jan 28 02:14:19.043103 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 528/1099] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:14:18 2022] GET /compute/v2.1/servers/f15bc945-3a06-4b6e-a78c-7f7a4704a9b4 => generated 1217 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:14:20.062296 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-bcc5d53d-3353-4622-88ab-8b63acc19b7c tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:14:20.062988 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-bcc5d53d-3353-4622-88ab-8b63acc19b7c tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] [instance: f15bc945-3a06-4b6e-a78c-7f7a4704a9b4] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:14:20.070228 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-bcc5d53d-3353-4622-88ab-8b63acc19b7c tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:20.075410 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-bcc5d53d-3353-4622-88ab-8b63acc19b7c tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:20.075410 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-bcc5d53d-3353-4622-88ab-8b63acc19b7c tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:20.075410 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-bcc5d53d-3353-4622-88ab-8b63acc19b7c tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:20.142930 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-bcc5d53d-3353-4622-88ab-8b63acc19b7c tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45e3859fd364a48b40248e2a383121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e977ea9e1f45ddbba1e5cfc40616be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:14:20.151458 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-bcc5d53d-3353-4622-88ab-8b63acc19b7c tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] 10.222.0.79 "GET /compute/v2.1/servers/f15bc945-3a06-4b6e-a78c-7f7a4704a9b4" status: 200 len: 1265 microversion: 2.1 time: 0.093206 Jan 28 02:14:20.155760 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 572/1100] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:14:20 2022] GET /compute/v2.1/servers/f15bc945-3a06-4b6e-a78c-7f7a4704a9b4 => generated 1265 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:14:21.169953 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-07701d36-f931-4716-a6a2-650d8c4dbe3e tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:14:21.170750 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-07701d36-f931-4716-a6a2-650d8c4dbe3e tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] [instance: f15bc945-3a06-4b6e-a78c-7f7a4704a9b4] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:14:21.177057 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-07701d36-f931-4716-a6a2-650d8c4dbe3e tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:21.177411 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-07701d36-f931-4716-a6a2-650d8c4dbe3e tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:21.178430 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-07701d36-f931-4716-a6a2-650d8c4dbe3e tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:21.178868 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-07701d36-f931-4716-a6a2-650d8c4dbe3e tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:21.260772 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-07701d36-f931-4716-a6a2-650d8c4dbe3e tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45e3859fd364a48b40248e2a383121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e977ea9e1f45ddbba1e5cfc40616be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:14:21.270054 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-07701d36-f931-4716-a6a2-650d8c4dbe3e tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] 10.222.0.79 "GET /compute/v2.1/servers/f15bc945-3a06-4b6e-a78c-7f7a4704a9b4" status: 200 len: 1283 microversion: 2.1 time: 0.103163 Jan 28 02:14:21.272749 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 529/1101] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:14:21 2022] GET /compute/v2.1/servers/f15bc945-3a06-4b6e-a78c-7f7a4704a9b4 => generated 1283 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:14:22.290402 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-7a188329-8687-4be6-a419-4f79e631f40b tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:14:22.291266 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-7a188329-8687-4be6-a419-4f79e631f40b tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] [instance: f15bc945-3a06-4b6e-a78c-7f7a4704a9b4] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:14:22.299213 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-7a188329-8687-4be6-a419-4f79e631f40b tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:22.299660 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-7a188329-8687-4be6-a419-4f79e631f40b tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:22.300492 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-7a188329-8687-4be6-a419-4f79e631f40b tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:22.300920 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-7a188329-8687-4be6-a419-4f79e631f40b tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:22.556298 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-7a188329-8687-4be6-a419-4f79e631f40b tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45e3859fd364a48b40248e2a383121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e977ea9e1f45ddbba1e5cfc40616be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:14:22.563629 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-7a188329-8687-4be6-a419-4f79e631f40b tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] 10.222.0.79 "GET /compute/v2.1/servers/f15bc945-3a06-4b6e-a78c-7f7a4704a9b4" status: 200 len: 1313 microversion: 2.1 time: 0.278011 Jan 28 02:14:22.564463 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 573/1102] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:14:22 2022] GET /compute/v2.1/servers/f15bc945-3a06-4b6e-a78c-7f7a4704a9b4 => generated 1313 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:14:23.103741 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [req-6bccd353-95b1-4c1f-b93d-69b6c9056e19 req-9563196e-b4e4-4df7-a4bb-c53cd15a8ed0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f15bc945-3a06-4b6e-a78c-7f7a4704a9b4", "tag": "d2bf62e1-ee5e-4d62-8543-82125313cba3"}]} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:14:23.105778 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:14:23.105778 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: warnings.warn(msg) Jan 28 02:14:23.114050 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-6bccd353-95b1-4c1f-b93d-69b6c9056e19 req-9563196e-b4e4-4df7-a4bb-c53cd15a8ed0 service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:23.114590 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-6bccd353-95b1-4c1f-b93d-69b6c9056e19 req-9563196e-b4e4-4df7-a4bb-c53cd15a8ed0 service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:23.127846 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.compute.server_external_events [req-6bccd353-95b1-4c1f-b93d-69b6c9056e19 req-9563196e-b4e4-4df7-a4bb-c53cd15a8ed0 service nova] Creating event network-changed:d2bf62e1-ee5e-4d62-8543-82125313cba3 for instance f15bc945-3a06-4b6e-a78c-7f7a4704a9b4 on hv-cinder-82497 Jan 28 02:14:23.133607 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [req-6bccd353-95b1-4c1f-b93d-69b6c9056e19 req-9563196e-b4e4-4df7-a4bb-c53cd15a8ed0 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037214 Jan 28 02:14:23.134445 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 530/1103] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Jan 28 02:14:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 02:14:23.580834 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-8a6c7ab3-2af4-4cdb-827f-339ac9430b66 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:14:23.581442 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-8a6c7ab3-2af4-4cdb-827f-339ac9430b66 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] [instance: f15bc945-3a06-4b6e-a78c-7f7a4704a9b4] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:14:23.588430 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-8a6c7ab3-2af4-4cdb-827f-339ac9430b66 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:23.588876 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-8a6c7ab3-2af4-4cdb-827f-339ac9430b66 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:23.589680 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-8a6c7ab3-2af4-4cdb-827f-339ac9430b66 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:23.590112 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-8a6c7ab3-2af4-4cdb-827f-339ac9430b66 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:23.834977 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-8a6c7ab3-2af4-4cdb-827f-339ac9430b66 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45e3859fd364a48b40248e2a383121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e977ea9e1f45ddbba1e5cfc40616be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:14:23.836368 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-8a6c7ab3-2af4-4cdb-827f-339ac9430b66 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] 10.222.0.79 "GET /compute/v2.1/servers/f15bc945-3a06-4b6e-a78c-7f7a4704a9b4" status: 200 len: 1313 microversion: 2.1 time: 0.259035 Jan 28 02:14:23.837088 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 574/1104] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:14:23 2022] GET /compute/v2.1/servers/f15bc945-3a06-4b6e-a78c-7f7a4704a9b4 => generated 1313 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:14:24.547321 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 28 02:14:24.547579 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: Fri Jan 28 02:14:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 28 02:14:24.855039 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-6488b856-2f47-45f7-8ebc-e2e9453bc152 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:14:24.855635 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-6488b856-2f47-45f7-8ebc-e2e9453bc152 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] [instance: f15bc945-3a06-4b6e-a78c-7f7a4704a9b4] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:14:24.861855 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-6488b856-2f47-45f7-8ebc-e2e9453bc152 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:24.862291 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-6488b856-2f47-45f7-8ebc-e2e9453bc152 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:24.863048 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-6488b856-2f47-45f7-8ebc-e2e9453bc152 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:24.863468 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-6488b856-2f47-45f7-8ebc-e2e9453bc152 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:24.988381 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-6488b856-2f47-45f7-8ebc-e2e9453bc152 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45e3859fd364a48b40248e2a383121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e977ea9e1f45ddbba1e5cfc40616be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:14:24.996501 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-6488b856-2f47-45f7-8ebc-e2e9453bc152 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] 10.222.0.79 "GET /compute/v2.1/servers/f15bc945-3a06-4b6e-a78c-7f7a4704a9b4" status: 200 len: 1313 microversion: 2.1 time: 0.145841 Jan 28 02:14:24.997230 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 531/1105] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:14:24 2022] GET /compute/v2.1/servers/f15bc945-3a06-4b6e-a78c-7f7a4704a9b4 => generated 1313 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:14:26.018285 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-3120a064-630e-4a05-9edb-15d36e698ef8 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:14:26.018285 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-3120a064-630e-4a05-9edb-15d36e698ef8 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] [instance: f15bc945-3a06-4b6e-a78c-7f7a4704a9b4] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:14:26.023445 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-3120a064-630e-4a05-9edb-15d36e698ef8 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:26.023899 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-3120a064-630e-4a05-9edb-15d36e698ef8 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:26.024746 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-3120a064-630e-4a05-9edb-15d36e698ef8 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:26.025182 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-3120a064-630e-4a05-9edb-15d36e698ef8 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:26.261421 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-3120a064-630e-4a05-9edb-15d36e698ef8 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45e3859fd364a48b40248e2a383121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e977ea9e1f45ddbba1e5cfc40616be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:14:26.272504 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-3120a064-630e-4a05-9edb-15d36e698ef8 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] 10.222.0.79 "GET /compute/v2.1/servers/f15bc945-3a06-4b6e-a78c-7f7a4704a9b4" status: 200 len: 1313 microversion: 2.1 time: 0.261494 Jan 28 02:14:26.273402 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 575/1106] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:14:26 2022] GET /compute/v2.1/servers/f15bc945-3a06-4b6e-a78c-7f7a4704a9b4 => generated 1313 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:14:27.291581 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-9e20e8e2-a2a9-492c-9489-aef29f0ba47b tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:14:27.292312 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-9e20e8e2-a2a9-492c-9489-aef29f0ba47b tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] [instance: f15bc945-3a06-4b6e-a78c-7f7a4704a9b4] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:14:27.299248 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-9e20e8e2-a2a9-492c-9489-aef29f0ba47b tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:27.299694 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-9e20e8e2-a2a9-492c-9489-aef29f0ba47b tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:27.300531 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-9e20e8e2-a2a9-492c-9489-aef29f0ba47b tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:27.300958 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-9e20e8e2-a2a9-492c-9489-aef29f0ba47b tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:27.502628 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-9e20e8e2-a2a9-492c-9489-aef29f0ba47b tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45e3859fd364a48b40248e2a383121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e977ea9e1f45ddbba1e5cfc40616be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:14:27.513563 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-9e20e8e2-a2a9-492c-9489-aef29f0ba47b tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] 10.222.0.79 "GET /compute/v2.1/servers/f15bc945-3a06-4b6e-a78c-7f7a4704a9b4" status: 200 len: 1313 microversion: 2.1 time: 0.226442 Jan 28 02:14:27.514418 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 532/1107] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:14:27 2022] GET /compute/v2.1/servers/f15bc945-3a06-4b6e-a78c-7f7a4704a9b4 => generated 1313 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:14:28.385011 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [req-04ab8c22-fdf4-47ff-80ad-18ad494b72a0 req-8a347a5b-c684-4c2e-a7f2-ec3f938c9399 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f15bc945-3a06-4b6e-a78c-7f7a4704a9b4", "name": "network-vif-plugged", "status": "completed", "tag": "d2bf62e1-ee5e-4d62-8543-82125313cba3"}]} {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:14:28.387074 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:14:28.387074 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: warnings.warn(msg) Jan 28 02:14:28.397324 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [req-04ab8c22-fdf4-47ff-80ad-18ad494b72a0 req-8a347a5b-c684-4c2e-a7f2-ec3f938c9399 service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:28.397324 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [req-04ab8c22-fdf4-47ff-80ad-18ad494b72a0 req-8a347a5b-c684-4c2e-a7f2-ec3f938c9399 service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:28.407842 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.compute.server_external_events [req-04ab8c22-fdf4-47ff-80ad-18ad494b72a0 req-8a347a5b-c684-4c2e-a7f2-ec3f938c9399 service nova] Creating event network-vif-plugged:d2bf62e1-ee5e-4d62-8543-82125313cba3 for instance f15bc945-3a06-4b6e-a78c-7f7a4704a9b4 on hv-cinder-82497 Jan 28 02:14:28.414906 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [req-04ab8c22-fdf4-47ff-80ad-18ad494b72a0 req-8a347a5b-c684-4c2e-a7f2-ec3f938c9399 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034319 Jan 28 02:14:28.415927 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 576/1108] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Jan 28 02:14:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:14:28.531465 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-1df6dc4e-5159-4892-91eb-a33beae81483 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:14:28.532106 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-1df6dc4e-5159-4892-91eb-a33beae81483 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] [instance: f15bc945-3a06-4b6e-a78c-7f7a4704a9b4] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:14:28.539090 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-1df6dc4e-5159-4892-91eb-a33beae81483 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:28.539806 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-1df6dc4e-5159-4892-91eb-a33beae81483 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:28.540798 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-1df6dc4e-5159-4892-91eb-a33beae81483 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:28.542284 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-1df6dc4e-5159-4892-91eb-a33beae81483 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:28.682739 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-1df6dc4e-5159-4892-91eb-a33beae81483 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45e3859fd364a48b40248e2a383121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e977ea9e1f45ddbba1e5cfc40616be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:14:28.691028 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-1df6dc4e-5159-4892-91eb-a33beae81483 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] 10.222.0.79 "GET /compute/v2.1/servers/f15bc945-3a06-4b6e-a78c-7f7a4704a9b4" status: 200 len: 1313 microversion: 2.1 time: 0.163193 Jan 28 02:14:28.693987 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 533/1109] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:14:28 2022] GET /compute/v2.1/servers/f15bc945-3a06-4b6e-a78c-7f7a4704a9b4 => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:14:29.710129 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-c567c172-d3cf-4088-94fa-621c4529da14 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:14:29.710843 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-c567c172-d3cf-4088-94fa-621c4529da14 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] [instance: f15bc945-3a06-4b6e-a78c-7f7a4704a9b4] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:14:29.717411 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-c567c172-d3cf-4088-94fa-621c4529da14 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:29.717855 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-c567c172-d3cf-4088-94fa-621c4529da14 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:29.718644 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-c567c172-d3cf-4088-94fa-621c4529da14 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:29.719077 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-c567c172-d3cf-4088-94fa-621c4529da14 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:29.850368 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-c567c172-d3cf-4088-94fa-621c4529da14 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45e3859fd364a48b40248e2a383121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e977ea9e1f45ddbba1e5cfc40616be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:14:29.858155 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-c567c172-d3cf-4088-94fa-621c4529da14 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] 10.222.0.79 "GET /compute/v2.1/servers/f15bc945-3a06-4b6e-a78c-7f7a4704a9b4" status: 200 len: 1313 microversion: 2.1 time: 0.152780 Jan 28 02:14:29.858739 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 577/1110] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:14:29 2022] GET /compute/v2.1/servers/f15bc945-3a06-4b6e-a78c-7f7a4704a9b4 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:14:30.875574 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-0d290295-9969-49e8-aef5-01410d233cb1 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:14:30.876173 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-0d290295-9969-49e8-aef5-01410d233cb1 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] [instance: f15bc945-3a06-4b6e-a78c-7f7a4704a9b4] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:14:30.882486 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-0d290295-9969-49e8-aef5-01410d233cb1 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:30.882929 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-0d290295-9969-49e8-aef5-01410d233cb1 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:30.883731 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-0d290295-9969-49e8-aef5-01410d233cb1 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:30.884206 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-0d290295-9969-49e8-aef5-01410d233cb1 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:31.009973 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-0d290295-9969-49e8-aef5-01410d233cb1 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45e3859fd364a48b40248e2a383121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e977ea9e1f45ddbba1e5cfc40616be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:14:31.018528 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-0d290295-9969-49e8-aef5-01410d233cb1 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] 10.222.0.79 "GET /compute/v2.1/servers/f15bc945-3a06-4b6e-a78c-7f7a4704a9b4" status: 200 len: 1497 microversion: 2.1 time: 0.146704 Jan 28 02:14:31.019112 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 534/1111] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:14:30 2022] GET /compute/v2.1/servers/f15bc945-3a06-4b6e-a78c-7f7a4704a9b4 => generated 1497 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:14:32.102385 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-fe1516c8-961b-4db5-91da-6c213fe66623 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:14:32.102978 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-fe1516c8-961b-4db5-91da-6c213fe66623 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] [instance: f15bc945-3a06-4b6e-a78c-7f7a4704a9b4] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:14:32.108872 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-fe1516c8-961b-4db5-91da-6c213fe66623 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:32.109311 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-fe1516c8-961b-4db5-91da-6c213fe66623 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:32.110073 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-fe1516c8-961b-4db5-91da-6c213fe66623 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:32.110508 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-fe1516c8-961b-4db5-91da-6c213fe66623 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:32.136765 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-fe1516c8-961b-4db5-91da-6c213fe66623 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] [instance: f15bc945-3a06-4b6e-a78c-7f7a4704a9b4] Going to try to terminate instance {{(pid=116374) delete /opt/stack/nova/nova/compute/api.py:2612}} Jan 28 02:14:32.454507 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-fe1516c8-961b-4db5-91da-6c213fe66623 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] 10.222.0.79 "DELETE /compute/v2.1/servers/f15bc945-3a06-4b6e-a78c-7f7a4704a9b4" status: 204 len: 0 microversion: 2.1 time: 0.355697 Jan 28 02:14:32.455448 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 578/1112] 10.222.0.79 () {58 vars in 1238 bytes} [Fri Jan 28 02:14:32 2022] DELETE /compute/v2.1/servers/f15bc945-3a06-4b6e-a78c-7f7a4704a9b4 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 28 02:14:32.463688 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-fd85ab52-8949-4821-9a73-348af70e6ab0 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:14:32.469809 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-fd85ab52-8949-4821-9a73-348af70e6ab0 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] [instance: f15bc945-3a06-4b6e-a78c-7f7a4704a9b4] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:14:32.470353 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-fd85ab52-8949-4821-9a73-348af70e6ab0 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:32.470798 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-fd85ab52-8949-4821-9a73-348af70e6ab0 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:32.471559 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-fd85ab52-8949-4821-9a73-348af70e6ab0 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:32.472008 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-fd85ab52-8949-4821-9a73-348af70e6ab0 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:32.594926 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-fd85ab52-8949-4821-9a73-348af70e6ab0 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45e3859fd364a48b40248e2a383121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e977ea9e1f45ddbba1e5cfc40616be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:14:32.603558 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-fd85ab52-8949-4821-9a73-348af70e6ab0 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] 10.222.0.79 "GET /compute/v2.1/servers/f15bc945-3a06-4b6e-a78c-7f7a4704a9b4" status: 200 len: 1503 microversion: 2.1 time: 0.143426 Jan 28 02:14:32.604222 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 535/1113] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:14:32 2022] GET /compute/v2.1/servers/f15bc945-3a06-4b6e-a78c-7f7a4704a9b4 => generated 1503 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:14:33.336260 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-19670443-0d38-417a-8954-95741d9f42a3 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1998933002", "imageRef": "04805ce8-b0a0-41b2-b614-bfb5b752cc5d", "flavorRef": "452", "networks": [{"uuid": "c1617250-6906-428a-b42f-41a62d6e9eab"}]}} {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:14:33.386990 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.network.neutron [None req-19670443-0d38-417a-8954-95741d9f42a3 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] validate_networks() for [('c1617250-6906-428a-b42f-41a62d6e9eab', None, None, None, None, None)] {{(pid=116374) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Jan 28 02:14:33.622334 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-a2238228-3b5e-4a2a-b45b-c6fb066f24f6 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:14:33.622870 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-a2238228-3b5e-4a2a-b45b-c6fb066f24f6 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] [instance: f15bc945-3a06-4b6e-a78c-7f7a4704a9b4] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:14:33.628506 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a2238228-3b5e-4a2a-b45b-c6fb066f24f6 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:33.628945 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a2238228-3b5e-4a2a-b45b-c6fb066f24f6 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:33.629708 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a2238228-3b5e-4a2a-b45b-c6fb066f24f6 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:33.630131 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a2238228-3b5e-4a2a-b45b-c6fb066f24f6 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:33.776743 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.virt.hardware [None req-19670443-0d38-417a-8954-95741d9f42a3 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Flavor limits 0:0:0 {{(pid=116374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 02:14:33.777540 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.virt.hardware [None req-19670443-0d38-417a-8954-95741d9f42a3 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Image limits 0:0:0 {{(pid=116374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 02:14:33.778226 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.virt.hardware [None req-19670443-0d38-417a-8954-95741d9f42a3 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Flavor pref 0:0:0 {{(pid=116374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 02:14:33.778838 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.virt.hardware [None req-19670443-0d38-417a-8954-95741d9f42a3 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Image pref 0:0:0 {{(pid=116374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 02:14:33.779549 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.virt.hardware [None req-19670443-0d38-417a-8954-95741d9f42a3 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 02:14:33.790455 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-19670443-0d38-417a-8954-95741d9f42a3 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:33.791249 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-19670443-0d38-417a-8954-95741d9f42a3 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:33.792471 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-19670443-0d38-417a-8954-95741d9f42a3 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:33.793271 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-19670443-0d38-417a-8954-95741d9f42a3 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:33.811091 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-a2238228-3b5e-4a2a-b45b-c6fb066f24f6 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45e3859fd364a48b40248e2a383121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e977ea9e1f45ddbba1e5cfc40616be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:14:33.819016 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.quota [None req-19670443-0d38-417a-8954-95741d9f42a3 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Getting quotas for project dfdaf77bcf5a4358b657de79f178fa6e. Resources: {'ram', 'cores', 'instances'} {{(pid=116374) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 02:14:33.819347 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-a2238228-3b5e-4a2a-b45b-c6fb066f24f6 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] 10.222.0.79 "GET /compute/v2.1/servers/f15bc945-3a06-4b6e-a78c-7f7a4704a9b4" status: 200 len: 1503 microversion: 2.1 time: 0.200558 Jan 28 02:14:33.820060 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 536/1114] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:14:33 2022] GET /compute/v2.1/servers/f15bc945-3a06-4b6e-a78c-7f7a4704a9b4 => generated 1503 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:14:33.823461 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.quota [None req-19670443-0d38-417a-8954-95741d9f42a3 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Getting quotas for user 6a44eea6c44247d0a40f007026b1fb93 and project dfdaf77bcf5a4358b657de79f178fa6e. Resources: {'ram', 'cores', 'instances'} {{(pid=116374) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 02:14:33.835039 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-19670443-0d38-417a-8954-95741d9f42a3 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Going to run 1 instances... {{(pid=116374) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 02:14:33.837528 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-19670443-0d38-417a-8954-95741d9f42a3 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] [instance: 900f2c3c-cc61-4571-9b4e-d60c85c7daa8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='04805ce8-b0a0-41b2-b614-bfb5b752cc5d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116374) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 02:14:33.953004 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-19670443-0d38-417a-8954-95741d9f42a3 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.621550 Jan 28 02:14:33.953653 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 579/1115] 10.222.0.79 () {60 vars in 1146 bytes} [Fri Jan 28 02:14:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 623 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 28 02:14:33.964521 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-e16775db-c26b-43c6-9ebf-99fbc8cd62c5 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:14:33.965196 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-e16775db-c26b-43c6-9ebf-99fbc8cd62c5 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] [instance: 900f2c3c-cc61-4571-9b4e-d60c85c7daa8] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:14:34.016317 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-e16775db-c26b-43c6-9ebf-99fbc8cd62c5 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a44eea6c44247d0a40f007026b1fb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfdaf77bcf5a4358b657de79f178fa6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:14:34.024364 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-e16775db-c26b-43c6-9ebf-99fbc8cd62c5 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] 10.222.0.79 "GET /compute/v2.1/servers/900f2c3c-cc61-4571-9b4e-d60c85c7daa8" status: 200 len: 1219 microversion: 2.1 time: 0.063400 Jan 28 02:14:34.025114 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 537/1116] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:14:33 2022] GET /compute/v2.1/servers/900f2c3c-cc61-4571-9b4e-d60c85c7daa8 => generated 1219 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:14:34.692352 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [req-1f9d0156-c5f6-4cd6-9fe3-917d0072be8d req-57e1f025-836f-4e65-93d0-0fd02658a74c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f15bc945-3a06-4b6e-a78c-7f7a4704a9b4", "name": "network-vif-deleted", "tag": "d2bf62e1-ee5e-4d62-8543-82125313cba3"}]} {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:14:34.694995 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:14:34.694995 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: warnings.warn(msg) Jan 28 02:14:34.702318 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [req-1f9d0156-c5f6-4cd6-9fe3-917d0072be8d req-57e1f025-836f-4e65-93d0-0fd02658a74c service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:34.702869 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [req-1f9d0156-c5f6-4cd6-9fe3-917d0072be8d req-57e1f025-836f-4e65-93d0-0fd02658a74c service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:34.714666 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.compute.server_external_events [req-1f9d0156-c5f6-4cd6-9fe3-917d0072be8d req-57e1f025-836f-4e65-93d0-0fd02658a74c service nova] Creating event network-vif-deleted:d2bf62e1-ee5e-4d62-8543-82125313cba3 for instance f15bc945-3a06-4b6e-a78c-7f7a4704a9b4 on hv-cinder-82497 Jan 28 02:14:34.719839 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [req-1f9d0156-c5f6-4cd6-9fe3-917d0072be8d req-57e1f025-836f-4e65-93d0-0fd02658a74c service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031869 Jan 28 02:14:34.720471 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 580/1117] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Jan 28 02:14:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:14:34.836418 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-51e1336b-0f09-440c-b4c5-a4a1d7d470ba tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:14:34.842306 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-51e1336b-0f09-440c-b4c5-a4a1d7d470ba tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] [instance: f15bc945-3a06-4b6e-a78c-7f7a4704a9b4] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:14:34.843110 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-51e1336b-0f09-440c-b4c5-a4a1d7d470ba tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:34.843547 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-51e1336b-0f09-440c-b4c5-a4a1d7d470ba tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:34.844350 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-51e1336b-0f09-440c-b4c5-a4a1d7d470ba tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:34.844775 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-51e1336b-0f09-440c-b4c5-a4a1d7d470ba tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:34.905143 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-51e1336b-0f09-440c-b4c5-a4a1d7d470ba tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45e3859fd364a48b40248e2a383121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e977ea9e1f45ddbba1e5cfc40616be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:14:34.913580 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-51e1336b-0f09-440c-b4c5-a4a1d7d470ba tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] 10.222.0.79 "GET /compute/v2.1/servers/f15bc945-3a06-4b6e-a78c-7f7a4704a9b4" status: 200 len: 1461 microversion: 2.1 time: 0.080933 Jan 28 02:14:34.914357 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 538/1118] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:14:34 2022] GET /compute/v2.1/servers/f15bc945-3a06-4b6e-a78c-7f7a4704a9b4 => generated 1461 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:14:35.042929 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-5861e4ac-d785-409a-8fdb-59b55153be83 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:14:35.043682 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-5861e4ac-d785-409a-8fdb-59b55153be83 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] [instance: 900f2c3c-cc61-4571-9b4e-d60c85c7daa8] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:14:35.049788 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-5861e4ac-d785-409a-8fdb-59b55153be83 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:35.050226 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-5861e4ac-d785-409a-8fdb-59b55153be83 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:35.050986 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-5861e4ac-d785-409a-8fdb-59b55153be83 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:35.051409 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-5861e4ac-d785-409a-8fdb-59b55153be83 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:35.119057 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-5861e4ac-d785-409a-8fdb-59b55153be83 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a44eea6c44247d0a40f007026b1fb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfdaf77bcf5a4358b657de79f178fa6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:14:35.126252 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-5861e4ac-d785-409a-8fdb-59b55153be83 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] 10.222.0.79 "GET /compute/v2.1/servers/900f2c3c-cc61-4571-9b4e-d60c85c7daa8" status: 200 len: 1223 microversion: 2.1 time: 0.087303 Jan 28 02:14:35.126823 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 581/1119] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:14:35 2022] GET /compute/v2.1/servers/900f2c3c-cc61-4571-9b4e-d60c85c7daa8 => generated 1223 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:14:35.373313 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-9fbe674f-3662-4555-9bd0-e0a93e679e7a tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:14:35.373807 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-9fbe674f-3662-4555-9bd0-e0a93e679e7a tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] [instance: c405e3d0-6da8-4dac-9dc9-0c084024bb9f] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:14:35.379843 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-9fbe674f-3662-4555-9bd0-e0a93e679e7a tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:35.380911 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-9fbe674f-3662-4555-9bd0-e0a93e679e7a tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:35.381687 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-9fbe674f-3662-4555-9bd0-e0a93e679e7a tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:35.382124 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-9fbe674f-3662-4555-9bd0-e0a93e679e7a tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:35.406381 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-9fbe674f-3662-4555-9bd0-e0a93e679e7a tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] [instance: c405e3d0-6da8-4dac-9dc9-0c084024bb9f] Going to try to terminate instance {{(pid=116375) delete /opt/stack/nova/nova/compute/api.py:2612}} Jan 28 02:14:35.796671 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-9fbe674f-3662-4555-9bd0-e0a93e679e7a tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] 10.222.0.79 "DELETE /compute/v2.1/servers/c405e3d0-6da8-4dac-9dc9-0c084024bb9f" status: 204 len: 0 microversion: 2.1 time: 0.426953 Jan 28 02:14:35.797391 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 539/1120] 10.222.0.79 () {58 vars in 1238 bytes} [Fri Jan 28 02:14:35 2022] DELETE /compute/v2.1/servers/c405e3d0-6da8-4dac-9dc9-0c084024bb9f => generated 0 bytes in 429 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 28 02:14:35.805768 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-f0119ede-7d4a-42fe-bbf1-bd120a947ba6 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:14:35.812369 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-f0119ede-7d4a-42fe-bbf1-bd120a947ba6 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] [instance: c405e3d0-6da8-4dac-9dc9-0c084024bb9f] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:14:35.812369 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-f0119ede-7d4a-42fe-bbf1-bd120a947ba6 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:35.812778 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-f0119ede-7d4a-42fe-bbf1-bd120a947ba6 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:35.813549 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-f0119ede-7d4a-42fe-bbf1-bd120a947ba6 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:35.813978 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-f0119ede-7d4a-42fe-bbf1-bd120a947ba6 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:35.930994 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-dd885163-ef56-455b-b668-ecf882ec100d tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:14:35.931723 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-dd885163-ef56-455b-b668-ecf882ec100d tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] [instance: f15bc945-3a06-4b6e-a78c-7f7a4704a9b4] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:14:35.937845 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-dd885163-ef56-455b-b668-ecf882ec100d tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:35.938299 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-dd885163-ef56-455b-b668-ecf882ec100d tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:35.939103 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-dd885163-ef56-455b-b668-ecf882ec100d tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:35.939534 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-dd885163-ef56-455b-b668-ecf882ec100d tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:35.940216 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-f0119ede-7d4a-42fe-bbf1-bd120a947ba6 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cdbf7d369e4437eae7a36529d6cd623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed8db325d13496c9a417966e33b10a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:14:35.948006 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-f0119ede-7d4a-42fe-bbf1-bd120a947ba6 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] 10.222.0.79 "GET /compute/v2.1/servers/c405e3d0-6da8-4dac-9dc9-0c084024bb9f" status: 200 len: 1575 microversion: 2.1 time: 0.146381 Jan 28 02:14:35.948577 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 582/1121] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:14:35 2022] GET /compute/v2.1/servers/c405e3d0-6da8-4dac-9dc9-0c084024bb9f => generated 1575 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:14:35.971348 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-dd885163-ef56-455b-b668-ecf882ec100d tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:35.971813 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-dd885163-ef56-455b-b668-ecf882ec100d tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:35.972543 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.objects.instance [None req-dd885163-ef56-455b-b668-ecf882ec100d tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Lazy-loading 'fault' on Instance uuid f15bc945-3a06-4b6e-a78c-7f7a4704a9b4 {{(pid=116375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jan 28 02:14:36.012619 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-dd885163-ef56-455b-b668-ecf882ec100d tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45e3859fd364a48b40248e2a383121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e977ea9e1f45ddbba1e5cfc40616be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:14:36.020307 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-dd885163-ef56-455b-b668-ecf882ec100d tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] 10.222.0.79 "GET /compute/v2.1/servers/f15bc945-3a06-4b6e-a78c-7f7a4704a9b4" status: 200 len: 1303 microversion: 2.1 time: 0.093311 Jan 28 02:14:36.021395 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 540/1122] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:14:35 2022] GET /compute/v2.1/servers/f15bc945-3a06-4b6e-a78c-7f7a4704a9b4 => generated 1303 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:14:36.144374 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-dea63034-ddff-43e2-9c93-f35885fbb65f tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:14:36.144606 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-dea63034-ddff-43e2-9c93-f35885fbb65f tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] [instance: 900f2c3c-cc61-4571-9b4e-d60c85c7daa8] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:14:36.151276 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-dea63034-ddff-43e2-9c93-f35885fbb65f tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:36.151668 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-dea63034-ddff-43e2-9c93-f35885fbb65f tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:36.152487 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-dea63034-ddff-43e2-9c93-f35885fbb65f tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:36.152914 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-dea63034-ddff-43e2-9c93-f35885fbb65f tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:36.212545 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-dea63034-ddff-43e2-9c93-f35885fbb65f tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a44eea6c44247d0a40f007026b1fb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfdaf77bcf5a4358b657de79f178fa6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:14:36.220104 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-dea63034-ddff-43e2-9c93-f35885fbb65f tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] 10.222.0.79 "GET /compute/v2.1/servers/900f2c3c-cc61-4571-9b4e-d60c85c7daa8" status: 200 len: 1271 microversion: 2.1 time: 0.080151 Jan 28 02:14:36.220671 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 583/1123] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:14:36 2022] GET /compute/v2.1/servers/900f2c3c-cc61-4571-9b4e-d60c85c7daa8 => generated 1271 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:14:36.965192 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-1e317359-b963-4acf-b360-da7001f844c3 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:14:36.965826 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-1e317359-b963-4acf-b360-da7001f844c3 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] [instance: c405e3d0-6da8-4dac-9dc9-0c084024bb9f] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:14:36.971652 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-1e317359-b963-4acf-b360-da7001f844c3 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:36.972106 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-1e317359-b963-4acf-b360-da7001f844c3 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:36.977485 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-1e317359-b963-4acf-b360-da7001f844c3 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:36.977485 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-1e317359-b963-4acf-b360-da7001f844c3 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:37.039215 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-ea8486a4-ecc8-44d7-8537-3bb032928348 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:14:37.043966 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-ea8486a4-ecc8-44d7-8537-3bb032928348 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] [instance: f15bc945-3a06-4b6e-a78c-7f7a4704a9b4] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:14:37.053245 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-ea8486a4-ecc8-44d7-8537-3bb032928348 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:37.053724 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-ea8486a4-ecc8-44d7-8537-3bb032928348 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:37.054521 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-ea8486a4-ecc8-44d7-8537-3bb032928348 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:37.054959 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-ea8486a4-ecc8-44d7-8537-3bb032928348 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:37.069875 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.wsgi [None req-ea8486a4-ecc8-44d7-8537-3bb032928348 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] HTTP exception thrown: Instance f15bc945-3a06-4b6e-a78c-7f7a4704a9b4 could not be found. Jan 28 02:14:37.069875 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-ea8486a4-ecc8-44d7-8537-3bb032928348 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Returning 404 to user: Instance f15bc945-3a06-4b6e-a78c-7f7a4704a9b4 could not be found. {{(pid=116374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 02:14:37.070903 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-ea8486a4-ecc8-44d7-8537-3bb032928348 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] 10.222.0.79 "GET /compute/v2.1/servers/f15bc945-3a06-4b6e-a78c-7f7a4704a9b4" status: 404 len: 111 microversion: 2.1 time: 0.036546 Jan 28 02:14:37.071499 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 584/1124] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:14:37 2022] GET /compute/v2.1/servers/f15bc945-3a06-4b6e-a78c-7f7a4704a9b4 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 28 02:14:37.169917 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-9a7d4a02-1450-4e7f-abfa-eb212a446c1d tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-217628484", "imageRef": "04805ce8-b0a0-41b2-b614-bfb5b752cc5d", "flavorRef": "452", "networks": [{"uuid": "71599fa5-1b53-41d1-82ec-e6b2105a5144"}]}} {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:14:37.181527 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-1e317359-b963-4acf-b360-da7001f844c3 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cdbf7d369e4437eae7a36529d6cd623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed8db325d13496c9a417966e33b10a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:14:37.189320 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-1e317359-b963-4acf-b360-da7001f844c3 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] 10.222.0.79 "GET /compute/v2.1/servers/c405e3d0-6da8-4dac-9dc9-0c084024bb9f" status: 200 len: 1575 microversion: 2.1 time: 0.227852 Jan 28 02:14:37.190045 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 541/1125] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:14:36 2022] GET /compute/v2.1/servers/c405e3d0-6da8-4dac-9dc9-0c084024bb9f => generated 1575 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:14:37.226959 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.network.neutron [None req-9a7d4a02-1450-4e7f-abfa-eb212a446c1d tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] validate_networks() for [('71599fa5-1b53-41d1-82ec-e6b2105a5144', None, None, None, None, None)] {{(pid=116374) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Jan 28 02:14:37.245394 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-61d109f6-c9c1-48a2-b8e4-66779bebc3c8 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:14:37.246012 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-61d109f6-c9c1-48a2-b8e4-66779bebc3c8 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] [instance: 900f2c3c-cc61-4571-9b4e-d60c85c7daa8] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:14:37.251678 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-61d109f6-c9c1-48a2-b8e4-66779bebc3c8 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:37.252155 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-61d109f6-c9c1-48a2-b8e4-66779bebc3c8 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:37.252943 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-61d109f6-c9c1-48a2-b8e4-66779bebc3c8 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:37.253369 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-61d109f6-c9c1-48a2-b8e4-66779bebc3c8 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:37.348281 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-61d109f6-c9c1-48a2-b8e4-66779bebc3c8 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a44eea6c44247d0a40f007026b1fb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfdaf77bcf5a4358b657de79f178fa6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:14:37.356404 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-61d109f6-c9c1-48a2-b8e4-66779bebc3c8 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] 10.222.0.79 "GET /compute/v2.1/servers/900f2c3c-cc61-4571-9b4e-d60c85c7daa8" status: 200 len: 1277 microversion: 2.1 time: 0.114774 Jan 28 02:14:37.356982 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 542/1126] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:14:37 2022] GET /compute/v2.1/servers/900f2c3c-cc61-4571-9b4e-d60c85c7daa8 => generated 1277 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:14:37.744492 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.virt.hardware [None req-9a7d4a02-1450-4e7f-abfa-eb212a446c1d tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Flavor limits 0:0:0 {{(pid=116374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 02:14:37.744915 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.virt.hardware [None req-9a7d4a02-1450-4e7f-abfa-eb212a446c1d tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Image limits 0:0:0 {{(pid=116374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 02:14:37.745381 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.virt.hardware [None req-9a7d4a02-1450-4e7f-abfa-eb212a446c1d tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Flavor pref 0:0:0 {{(pid=116374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 02:14:37.745782 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.virt.hardware [None req-9a7d4a02-1450-4e7f-abfa-eb212a446c1d tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Image pref 0:0:0 {{(pid=116374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 02:14:37.746187 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.virt.hardware [None req-9a7d4a02-1450-4e7f-abfa-eb212a446c1d tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 02:14:37.756583 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-9a7d4a02-1450-4e7f-abfa-eb212a446c1d tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:37.762740 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-9a7d4a02-1450-4e7f-abfa-eb212a446c1d tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:37.762740 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-9a7d4a02-1450-4e7f-abfa-eb212a446c1d tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:37.762740 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-9a7d4a02-1450-4e7f-abfa-eb212a446c1d tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:37.774882 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.quota [None req-9a7d4a02-1450-4e7f-abfa-eb212a446c1d tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Getting quotas for project 42e977ea9e1f45ddbba1e5cfc40616be. Resources: {'ram', 'cores', 'instances'} {{(pid=116374) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 02:14:37.779018 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.quota [None req-9a7d4a02-1450-4e7f-abfa-eb212a446c1d tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Getting quotas for user d45e3859fd364a48b40248e2a383121d and project 42e977ea9e1f45ddbba1e5cfc40616be. Resources: {'ram', 'cores', 'instances'} {{(pid=116374) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 02:14:37.790178 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-9a7d4a02-1450-4e7f-abfa-eb212a446c1d tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Going to run 1 instances... {{(pid=116374) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 02:14:37.792530 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-9a7d4a02-1450-4e7f-abfa-eb212a446c1d tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] [instance: 78b24526-46a7-4507-90e0-1273ba252135] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='04805ce8-b0a0-41b2-b614-bfb5b752cc5d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116374) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 02:14:37.884181 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-9a7d4a02-1450-4e7f-abfa-eb212a446c1d tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.717920 Jan 28 02:14:37.885006 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 585/1127] 10.222.0.79 () {60 vars in 1146 bytes} [Fri Jan 28 02:14:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 719 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jan 28 02:14:37.894795 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-fb977598-4e81-4304-8b39-8da3f6f6ea27 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:14:37.895402 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-fb977598-4e81-4304-8b39-8da3f6f6ea27 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] [instance: 78b24526-46a7-4507-90e0-1273ba252135] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:14:37.995830 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-fb977598-4e81-4304-8b39-8da3f6f6ea27 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45e3859fd364a48b40248e2a383121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e977ea9e1f45ddbba1e5cfc40616be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:14:38.002590 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-fb977598-4e81-4304-8b39-8da3f6f6ea27 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] 10.222.0.79 "GET /compute/v2.1/servers/78b24526-46a7-4507-90e0-1273ba252135" status: 200 len: 1213 microversion: 2.1 time: 0.111464 Jan 28 02:14:38.003359 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 543/1128] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:14:37 2022] GET /compute/v2.1/servers/78b24526-46a7-4507-90e0-1273ba252135 => generated 1213 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:14:38.209199 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-07cebc55-d4cf-4909-aa5f-c7a94138389a tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:14:38.209857 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-07cebc55-d4cf-4909-aa5f-c7a94138389a tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] [instance: c405e3d0-6da8-4dac-9dc9-0c084024bb9f] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:14:38.216406 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-07cebc55-d4cf-4909-aa5f-c7a94138389a tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:38.216887 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-07cebc55-d4cf-4909-aa5f-c7a94138389a tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:38.217670 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-07cebc55-d4cf-4909-aa5f-c7a94138389a tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:38.218107 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-07cebc55-d4cf-4909-aa5f-c7a94138389a tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:38.374388 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-9e211b5c-cd7c-40b4-bece-8c5215d5460a tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:14:38.375373 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-9e211b5c-cd7c-40b4-bece-8c5215d5460a tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] [instance: 900f2c3c-cc61-4571-9b4e-d60c85c7daa8] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:14:38.386407 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-9e211b5c-cd7c-40b4-bece-8c5215d5460a tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:38.387438 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-9e211b5c-cd7c-40b4-bece-8c5215d5460a tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:38.388358 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-9e211b5c-cd7c-40b4-bece-8c5215d5460a tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:38.388793 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-9e211b5c-cd7c-40b4-bece-8c5215d5460a tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:38.538710 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-07cebc55-d4cf-4909-aa5f-c7a94138389a tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cdbf7d369e4437eae7a36529d6cd623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed8db325d13496c9a417966e33b10a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:14:38.545897 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-07cebc55-d4cf-4909-aa5f-c7a94138389a tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] 10.222.0.79 "GET /compute/v2.1/servers/c405e3d0-6da8-4dac-9dc9-0c084024bb9f" status: 200 len: 1575 microversion: 2.1 time: 0.340912 Jan 28 02:14:38.546490 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 586/1129] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:14:38 2022] GET /compute/v2.1/servers/c405e3d0-6da8-4dac-9dc9-0c084024bb9f => generated 1575 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:14:38.755037 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-9e211b5c-cd7c-40b4-bece-8c5215d5460a tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a44eea6c44247d0a40f007026b1fb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfdaf77bcf5a4358b657de79f178fa6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:14:38.762441 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-9e211b5c-cd7c-40b4-bece-8c5215d5460a tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] 10.222.0.79 "GET /compute/v2.1/servers/900f2c3c-cc61-4571-9b4e-d60c85c7daa8" status: 200 len: 1319 microversion: 2.1 time: 0.391768 Jan 28 02:14:38.763095 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 544/1130] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:14:38 2022] GET /compute/v2.1/servers/900f2c3c-cc61-4571-9b4e-d60c85c7daa8 => generated 1319 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:14:39.021261 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-1c790abe-3602-45f7-aaa8-a120449b6c71 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:14:39.022102 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-1c790abe-3602-45f7-aaa8-a120449b6c71 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] [instance: 78b24526-46a7-4507-90e0-1273ba252135] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:14:39.028733 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-1c790abe-3602-45f7-aaa8-a120449b6c71 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:39.029175 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-1c790abe-3602-45f7-aaa8-a120449b6c71 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:39.029951 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-1c790abe-3602-45f7-aaa8-a120449b6c71 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:39.030377 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-1c790abe-3602-45f7-aaa8-a120449b6c71 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:39.156836 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-1c790abe-3602-45f7-aaa8-a120449b6c71 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45e3859fd364a48b40248e2a383121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e977ea9e1f45ddbba1e5cfc40616be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:14:39.164524 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-1c790abe-3602-45f7-aaa8-a120449b6c71 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] 10.222.0.79 "GET /compute/v2.1/servers/78b24526-46a7-4507-90e0-1273ba252135" status: 200 len: 1217 microversion: 2.1 time: 0.147552 Jan 28 02:14:39.165127 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 587/1131] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:14:39 2022] GET /compute/v2.1/servers/78b24526-46a7-4507-90e0-1273ba252135 => generated 1217 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:14:39.377819 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [req-e02fe608-431e-4117-ab20-9e04de5cfedd req-fec1b9c0-1d4e-49ca-adb3-41110c76d246 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "900f2c3c-cc61-4571-9b4e-d60c85c7daa8", "tag": "fc75dee7-62cc-4e1d-b6cb-1fc222e7d59c"}]} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:14:39.382310 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:14:39.382310 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: warnings.warn(msg) Jan 28 02:14:39.386548 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-e02fe608-431e-4117-ab20-9e04de5cfedd req-fec1b9c0-1d4e-49ca-adb3-41110c76d246 service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:39.387193 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-e02fe608-431e-4117-ab20-9e04de5cfedd req-fec1b9c0-1d4e-49ca-adb3-41110c76d246 service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:39.398152 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.compute.server_external_events [req-e02fe608-431e-4117-ab20-9e04de5cfedd req-fec1b9c0-1d4e-49ca-adb3-41110c76d246 service nova] Creating event network-changed:fc75dee7-62cc-4e1d-b6cb-1fc222e7d59c for instance 900f2c3c-cc61-4571-9b4e-d60c85c7daa8 on hv-cinder-82497 Jan 28 02:14:39.403029 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [req-e02fe608-431e-4117-ab20-9e04de5cfedd req-fec1b9c0-1d4e-49ca-adb3-41110c76d246 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028949 Jan 28 02:14:39.403616 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 545/1132] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Jan 28 02:14:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 02:14:39.577001 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-a46e7e9c-cf55-4359-a82d-392069376b22 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:14:39.577001 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-a46e7e9c-cf55-4359-a82d-392069376b22 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] [instance: c405e3d0-6da8-4dac-9dc9-0c084024bb9f] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:14:39.579450 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-a46e7e9c-cf55-4359-a82d-392069376b22 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:39.579999 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-a46e7e9c-cf55-4359-a82d-392069376b22 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:39.580777 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-a46e7e9c-cf55-4359-a82d-392069376b22 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:39.581237 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-a46e7e9c-cf55-4359-a82d-392069376b22 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:39.684541 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-a46e7e9c-cf55-4359-a82d-392069376b22 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cdbf7d369e4437eae7a36529d6cd623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed8db325d13496c9a417966e33b10a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:14:39.691866 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-a46e7e9c-cf55-4359-a82d-392069376b22 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] 10.222.0.79 "GET /compute/v2.1/servers/c405e3d0-6da8-4dac-9dc9-0c084024bb9f" status: 200 len: 1508 microversion: 2.1 time: 0.132632 Jan 28 02:14:39.692718 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 588/1133] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:14:39 2022] GET /compute/v2.1/servers/c405e3d0-6da8-4dac-9dc9-0c084024bb9f => generated 1508 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:14:39.778979 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-8870e958-0bcc-4175-986e-f17a1705963d tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:14:39.779665 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-8870e958-0bcc-4175-986e-f17a1705963d tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] [instance: 900f2c3c-cc61-4571-9b4e-d60c85c7daa8] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:14:39.785988 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-8870e958-0bcc-4175-986e-f17a1705963d tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:39.786540 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-8870e958-0bcc-4175-986e-f17a1705963d tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:39.788039 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-8870e958-0bcc-4175-986e-f17a1705963d tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:39.788492 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-8870e958-0bcc-4175-986e-f17a1705963d tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:40.057443 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-8870e958-0bcc-4175-986e-f17a1705963d tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a44eea6c44247d0a40f007026b1fb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfdaf77bcf5a4358b657de79f178fa6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:14:40.064907 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-8870e958-0bcc-4175-986e-f17a1705963d tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] 10.222.0.79 "GET /compute/v2.1/servers/900f2c3c-cc61-4571-9b4e-d60c85c7daa8" status: 200 len: 1319 microversion: 2.1 time: 0.289906 Jan 28 02:14:40.065485 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 546/1134] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:14:39 2022] GET /compute/v2.1/servers/900f2c3c-cc61-4571-9b4e-d60c85c7daa8 => generated 1319 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:14:40.182238 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-7a145834-9068-4966-8f1e-242937521721 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:14:40.184529 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-7a145834-9068-4966-8f1e-242937521721 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] [instance: 78b24526-46a7-4507-90e0-1273ba252135] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:14:40.189371 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-7a145834-9068-4966-8f1e-242937521721 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:40.189894 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-7a145834-9068-4966-8f1e-242937521721 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:40.190681 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-7a145834-9068-4966-8f1e-242937521721 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:40.191137 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-7a145834-9068-4966-8f1e-242937521721 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:40.260447 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-7a145834-9068-4966-8f1e-242937521721 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45e3859fd364a48b40248e2a383121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e977ea9e1f45ddbba1e5cfc40616be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:14:40.269128 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-7a145834-9068-4966-8f1e-242937521721 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] 10.222.0.79 "GET /compute/v2.1/servers/78b24526-46a7-4507-90e0-1273ba252135" status: 200 len: 1265 microversion: 2.1 time: 0.090647 Jan 28 02:14:40.269706 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 589/1135] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:14:40 2022] GET /compute/v2.1/servers/78b24526-46a7-4507-90e0-1273ba252135 => generated 1265 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:14:40.712216 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-4f731842-db50-4ed2-9f63-50d141297472 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:14:40.714484 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-4f731842-db50-4ed2-9f63-50d141297472 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] [instance: c405e3d0-6da8-4dac-9dc9-0c084024bb9f] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:14:40.727479 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-4f731842-db50-4ed2-9f63-50d141297472 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:40.728352 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-4f731842-db50-4ed2-9f63-50d141297472 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:40.730011 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-4f731842-db50-4ed2-9f63-50d141297472 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:40.731465 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-4f731842-db50-4ed2-9f63-50d141297472 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:40.809553 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-4f731842-db50-4ed2-9f63-50d141297472 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cdbf7d369e4437eae7a36529d6cd623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed8db325d13496c9a417966e33b10a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:14:40.818112 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-4f731842-db50-4ed2-9f63-50d141297472 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] 10.222.0.79 "GET /compute/v2.1/servers/c405e3d0-6da8-4dac-9dc9-0c084024bb9f" status: 200 len: 1225 microversion: 2.1 time: 0.111741 Jan 28 02:14:40.818949 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 547/1136] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:14:40 2022] GET /compute/v2.1/servers/c405e3d0-6da8-4dac-9dc9-0c084024bb9f => generated 1225 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:14:41.082057 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-02f99cc8-6307-4777-b202-eb2431fa92a2 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:14:41.084412 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-02f99cc8-6307-4777-b202-eb2431fa92a2 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] [instance: 900f2c3c-cc61-4571-9b4e-d60c85c7daa8] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:14:41.089176 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-02f99cc8-6307-4777-b202-eb2431fa92a2 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:41.089682 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-02f99cc8-6307-4777-b202-eb2431fa92a2 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:41.090568 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-02f99cc8-6307-4777-b202-eb2431fa92a2 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:41.091006 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-02f99cc8-6307-4777-b202-eb2431fa92a2 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:41.261996 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-02f99cc8-6307-4777-b202-eb2431fa92a2 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a44eea6c44247d0a40f007026b1fb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfdaf77bcf5a4358b657de79f178fa6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:14:41.269726 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-02f99cc8-6307-4777-b202-eb2431fa92a2 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] 10.222.0.79 "GET /compute/v2.1/servers/900f2c3c-cc61-4571-9b4e-d60c85c7daa8" status: 200 len: 1319 microversion: 2.1 time: 0.191310 Jan 28 02:14:41.270309 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 590/1137] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:14:41 2022] GET /compute/v2.1/servers/900f2c3c-cc61-4571-9b4e-d60c85c7daa8 => generated 1319 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:14:41.291319 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-eb739543-fe8e-4c1a-9417-3888222dc8b2 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:14:41.292528 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-eb739543-fe8e-4c1a-9417-3888222dc8b2 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] [instance: 78b24526-46a7-4507-90e0-1273ba252135] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:14:41.304737 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-eb739543-fe8e-4c1a-9417-3888222dc8b2 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:41.305567 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-eb739543-fe8e-4c1a-9417-3888222dc8b2 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:41.307090 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-eb739543-fe8e-4c1a-9417-3888222dc8b2 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:41.307886 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-eb739543-fe8e-4c1a-9417-3888222dc8b2 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:41.420665 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [req-a2135935-7232-4f22-8d8b-347b9f44c24d req-890f78de-690b-47cc-985e-cf476bdc65a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c405e3d0-6da8-4dac-9dc9-0c084024bb9f", "name": "network-vif-deleted", "tag": "972d33d2-8e4d-4169-af65-29a82d02d383"}]} {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:14:41.422317 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:14:41.422317 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: warnings.warn(msg) Jan 28 02:14:41.430300 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [req-a2135935-7232-4f22-8d8b-347b9f44c24d req-890f78de-690b-47cc-985e-cf476bdc65a2 service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:41.430737 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [req-a2135935-7232-4f22-8d8b-347b9f44c24d req-890f78de-690b-47cc-985e-cf476bdc65a2 service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:41.442824 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.compute.server_external_events [req-a2135935-7232-4f22-8d8b-347b9f44c24d req-890f78de-690b-47cc-985e-cf476bdc65a2 service nova] Creating event network-vif-deleted:972d33d2-8e4d-4169-af65-29a82d02d383 for instance c405e3d0-6da8-4dac-9dc9-0c084024bb9f on hv-cinder-82497 Jan 28 02:14:41.449169 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [req-a2135935-7232-4f22-8d8b-347b9f44c24d req-890f78de-690b-47cc-985e-cf476bdc65a2 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032007 Jan 28 02:14:41.449781 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 591/1138] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Jan 28 02:14:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 02:14:41.534733 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-eb739543-fe8e-4c1a-9417-3888222dc8b2 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45e3859fd364a48b40248e2a383121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e977ea9e1f45ddbba1e5cfc40616be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:14:41.543282 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-eb739543-fe8e-4c1a-9417-3888222dc8b2 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] 10.222.0.79 "GET /compute/v2.1/servers/78b24526-46a7-4507-90e0-1273ba252135" status: 200 len: 1313 microversion: 2.1 time: 0.260415 Jan 28 02:14:41.543922 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 548/1139] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:14:41 2022] GET /compute/v2.1/servers/78b24526-46a7-4507-90e0-1273ba252135 => generated 1313 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:14:41.835911 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-8564c62e-0ef0-4f50-a274-6baca818e51c tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:14:41.836621 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-8564c62e-0ef0-4f50-a274-6baca818e51c tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] [instance: c405e3d0-6da8-4dac-9dc9-0c084024bb9f] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:14:41.843469 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-8564c62e-0ef0-4f50-a274-6baca818e51c tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:41.843910 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-8564c62e-0ef0-4f50-a274-6baca818e51c tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:41.844918 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-8564c62e-0ef0-4f50-a274-6baca818e51c tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:41.845515 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-8564c62e-0ef0-4f50-a274-6baca818e51c tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:41.859401 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.wsgi [None req-8564c62e-0ef0-4f50-a274-6baca818e51c tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] HTTP exception thrown: Instance c405e3d0-6da8-4dac-9dc9-0c084024bb9f could not be found. Jan 28 02:14:41.860019 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-8564c62e-0ef0-4f50-a274-6baca818e51c tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Returning 404 to user: Instance c405e3d0-6da8-4dac-9dc9-0c084024bb9f could not be found. {{(pid=116374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 02:14:41.860854 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-8564c62e-0ef0-4f50-a274-6baca818e51c tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] 10.222.0.79 "GET /compute/v2.1/servers/c405e3d0-6da8-4dac-9dc9-0c084024bb9f" status: 404 len: 111 microversion: 2.1 time: 0.029814 Jan 28 02:14:41.861396 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 592/1140] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:14:41 2022] GET /compute/v2.1/servers/c405e3d0-6da8-4dac-9dc9-0c084024bb9f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 02:14:41.958179 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-461780a5-0268-4a91-8753-2eea99e15d82 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-123021148", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-710989458", "security_groups": [{"name": "tempest-secgroup-smoke-152893613"}], "block_device_mapping_v2": [{"uuid": "a7e74967-3ece-47c4-879f-0b6ef62355fa", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "7bcf169f-11e9-43c3-9cd8-36fa37c1812f"}]}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:14:42.070736 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.network.neutron [None req-461780a5-0268-4a91-8753-2eea99e15d82 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] validate_networks() for [('7bcf169f-11e9-43c3-9cd8-36fa37c1812f', None, None, None, None, None)] {{(pid=116375) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Jan 28 02:14:42.288049 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-ab9ba2a0-502e-486f-a398-a490cb260f3a tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:14:42.289378 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-ab9ba2a0-502e-486f-a398-a490cb260f3a tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] [instance: 900f2c3c-cc61-4571-9b4e-d60c85c7daa8] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:14:42.295797 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-ab9ba2a0-502e-486f-a398-a490cb260f3a tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:42.296211 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-ab9ba2a0-502e-486f-a398-a490cb260f3a tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:42.297092 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-ab9ba2a0-502e-486f-a398-a490cb260f3a tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:42.297600 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-ab9ba2a0-502e-486f-a398-a490cb260f3a tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:42.570296 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-ab9ba2a0-502e-486f-a398-a490cb260f3a tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a44eea6c44247d0a40f007026b1fb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfdaf77bcf5a4358b657de79f178fa6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:14:42.578894 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-ab9ba2a0-502e-486f-a398-a490cb260f3a tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] 10.222.0.79 "GET /compute/v2.1/servers/900f2c3c-cc61-4571-9b4e-d60c85c7daa8" status: 200 len: 1319 microversion: 2.1 time: 0.295343 Jan 28 02:14:42.585930 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 593/1141] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:14:42 2022] GET /compute/v2.1/servers/900f2c3c-cc61-4571-9b4e-d60c85c7daa8 => generated 1319 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:14:42.585930 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-8ad15aa4-80a6-4fbe-ba21-a54c7c257930 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:14:42.585930 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-8ad15aa4-80a6-4fbe-ba21-a54c7c257930 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] [instance: 78b24526-46a7-4507-90e0-1273ba252135] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:14:42.591807 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-8ad15aa4-80a6-4fbe-ba21-a54c7c257930 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:42.592343 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-8ad15aa4-80a6-4fbe-ba21-a54c7c257930 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:42.593199 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-8ad15aa4-80a6-4fbe-ba21-a54c7c257930 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:42.593766 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-8ad15aa4-80a6-4fbe-ba21-a54c7c257930 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:42.774223 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.virt.hardware [None req-461780a5-0268-4a91-8753-2eea99e15d82 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Flavor limits 0:0:0 {{(pid=116375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 02:14:42.774713 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.virt.hardware [None req-461780a5-0268-4a91-8753-2eea99e15d82 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Image limits 0:0:0 {{(pid=116375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 02:14:42.775183 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.virt.hardware [None req-461780a5-0268-4a91-8753-2eea99e15d82 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Flavor pref 0:0:0 {{(pid=116375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 02:14:42.775580 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.virt.hardware [None req-461780a5-0268-4a91-8753-2eea99e15d82 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Image pref 0:0:0 {{(pid=116375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 02:14:42.775998 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.virt.hardware [None req-461780a5-0268-4a91-8753-2eea99e15d82 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 02:14:42.784509 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-461780a5-0268-4a91-8753-2eea99e15d82 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:42.784952 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-461780a5-0268-4a91-8753-2eea99e15d82 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:42.785737 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-461780a5-0268-4a91-8753-2eea99e15d82 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:42.786161 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-461780a5-0268-4a91-8753-2eea99e15d82 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:42.803703 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.quota [None req-461780a5-0268-4a91-8753-2eea99e15d82 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Getting quotas for project 7ed8db325d13496c9a417966e33b10a1. Resources: {'ram', 'cores', 'instances'} {{(pid=116375) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 02:14:42.807607 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.quota [None req-461780a5-0268-4a91-8753-2eea99e15d82 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Getting quotas for user 4cdbf7d369e4437eae7a36529d6cd623 and project 7ed8db325d13496c9a417966e33b10a1. Resources: {'ram', 'cores', 'instances'} {{(pid=116375) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 02:14:42.839846 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-8ad15aa4-80a6-4fbe-ba21-a54c7c257930 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45e3859fd364a48b40248e2a383121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e977ea9e1f45ddbba1e5cfc40616be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:14:42.847577 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-8ad15aa4-80a6-4fbe-ba21-a54c7c257930 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] 10.222.0.79 "GET /compute/v2.1/servers/78b24526-46a7-4507-90e0-1273ba252135" status: 200 len: 1313 microversion: 2.1 time: 0.265872 Jan 28 02:14:42.848177 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 594/1142] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:14:42 2022] GET /compute/v2.1/servers/78b24526-46a7-4507-90e0-1273ba252135 => generated 1313 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:14:42.870346 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-461780a5-0268-4a91-8753-2eea99e15d82 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Going to run 1 instances... {{(pid=116375) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 02:14:42.872510 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-461780a5-0268-4a91-8753-2eea99e15d82 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] [instance: 678b2127-dbf6-4985-93ba-1171bae26d88] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a7e74967-3ece-47c4-879f-0b6ef62355fa',volume_size=None,volume_type=None)] {{(pid=116375) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 02:14:43.422156 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-461780a5-0268-4a91-8753-2eea99e15d82 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.467729 Jan 28 02:14:43.422884 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 549/1143] 10.222.0.79 () {60 vars in 1146 bytes} [Fri Jan 28 02:14:41 2022] POST /compute/v2.1/servers => generated 405 bytes in 1469 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 28 02:14:43.432837 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-36aa2b39-1e16-43f5-894c-37f0693acd3f tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:14:43.433553 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-36aa2b39-1e16-43f5-894c-37f0693acd3f tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] [instance: 678b2127-dbf6-4985-93ba-1171bae26d88] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:14:43.466919 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [req-1ae8f4bb-14cb-4d1a-a6cb-5fb94ec4af29 req-c5e31776-7962-4053-8c80-580824174796 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78b24526-46a7-4507-90e0-1273ba252135", "tag": "0fe5e297-3f96-48a7-a35a-88d100e855c5"}]} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:14:43.468487 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:14:43.468487 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: warnings.warn(msg) Jan 28 02:14:43.476950 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-1ae8f4bb-14cb-4d1a-a6cb-5fb94ec4af29 req-c5e31776-7962-4053-8c80-580824174796 service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:43.477395 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-1ae8f4bb-14cb-4d1a-a6cb-5fb94ec4af29 req-c5e31776-7962-4053-8c80-580824174796 service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:43.488496 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.compute.server_external_events [req-1ae8f4bb-14cb-4d1a-a6cb-5fb94ec4af29 req-c5e31776-7962-4053-8c80-580824174796 service nova] Creating event network-changed:0fe5e297-3f96-48a7-a35a-88d100e855c5 for instance 78b24526-46a7-4507-90e0-1273ba252135 on hv-cinder-82497 Jan 28 02:14:43.496215 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-36aa2b39-1e16-43f5-894c-37f0693acd3f tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cdbf7d369e4437eae7a36529d6cd623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed8db325d13496c9a417966e33b10a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:14:43.496531 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [req-1ae8f4bb-14cb-4d1a-a6cb-5fb94ec4af29 req-c5e31776-7962-4053-8c80-580824174796 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030034 Jan 28 02:14:43.497417 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 550/1144] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Jan 28 02:14:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 02:14:43.502568 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-36aa2b39-1e16-43f5-894c-37f0693acd3f tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] 10.222.0.79 "GET /compute/v2.1/servers/678b2127-dbf6-4985-93ba-1171bae26d88" status: 200 len: 1093 microversion: 2.1 time: 0.073415 Jan 28 02:14:43.503256 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 595/1145] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:14:43 2022] GET /compute/v2.1/servers/678b2127-dbf6-4985-93ba-1171bae26d88 => generated 1093 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:14:43.597273 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-50cec88a-0f8e-46f6-9924-119fab0392c5 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:14:43.598218 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-50cec88a-0f8e-46f6-9924-119fab0392c5 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] [instance: 900f2c3c-cc61-4571-9b4e-d60c85c7daa8] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:14:43.606983 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-50cec88a-0f8e-46f6-9924-119fab0392c5 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:43.607620 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-50cec88a-0f8e-46f6-9924-119fab0392c5 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:43.609697 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-50cec88a-0f8e-46f6-9924-119fab0392c5 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:43.610146 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-50cec88a-0f8e-46f6-9924-119fab0392c5 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:43.854666 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-50cec88a-0f8e-46f6-9924-119fab0392c5 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a44eea6c44247d0a40f007026b1fb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfdaf77bcf5a4358b657de79f178fa6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:14:43.862760 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-50cec88a-0f8e-46f6-9924-119fab0392c5 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] 10.222.0.79 "GET /compute/v2.1/servers/900f2c3c-cc61-4571-9b4e-d60c85c7daa8" status: 200 len: 1319 microversion: 2.1 time: 0.269409 Jan 28 02:14:43.863342 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 551/1146] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:14:43 2022] GET /compute/v2.1/servers/900f2c3c-cc61-4571-9b4e-d60c85c7daa8 => generated 1319 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:14:43.865451 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-0b1f7099-9a86-45cf-bf45-ece075c94290 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:14:43.866094 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-0b1f7099-9a86-45cf-bf45-ece075c94290 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] [instance: 78b24526-46a7-4507-90e0-1273ba252135] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:14:43.872284 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-0b1f7099-9a86-45cf-bf45-ece075c94290 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:43.872758 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-0b1f7099-9a86-45cf-bf45-ece075c94290 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:43.873528 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-0b1f7099-9a86-45cf-bf45-ece075c94290 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:43.874017 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-0b1f7099-9a86-45cf-bf45-ece075c94290 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:44.368415 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-0b1f7099-9a86-45cf-bf45-ece075c94290 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45e3859fd364a48b40248e2a383121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e977ea9e1f45ddbba1e5cfc40616be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:14:44.376093 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-0b1f7099-9a86-45cf-bf45-ece075c94290 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] 10.222.0.79 "GET /compute/v2.1/servers/78b24526-46a7-4507-90e0-1273ba252135" status: 200 len: 1313 microversion: 2.1 time: 0.514623 Jan 28 02:14:44.389820 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 596/1147] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:14:43 2022] GET /compute/v2.1/servers/78b24526-46a7-4507-90e0-1273ba252135 => generated 1313 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:14:44.484372 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [req-516d3a64-b347-4466-9a8b-31a1be8228af req-95461075-3bf0-4f42-a4b4-1659c1b5b036 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "900f2c3c-cc61-4571-9b4e-d60c85c7daa8", "name": "network-vif-plugged", "status": "completed", "tag": "fc75dee7-62cc-4e1d-b6cb-1fc222e7d59c"}]} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:14:44.485917 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:14:44.485917 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: warnings.warn(msg) Jan 28 02:14:44.493809 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-516d3a64-b347-4466-9a8b-31a1be8228af req-95461075-3bf0-4f42-a4b4-1659c1b5b036 service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:44.494357 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-516d3a64-b347-4466-9a8b-31a1be8228af req-95461075-3bf0-4f42-a4b4-1659c1b5b036 service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:44.507652 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.compute.server_external_events [req-516d3a64-b347-4466-9a8b-31a1be8228af req-95461075-3bf0-4f42-a4b4-1659c1b5b036 service nova] Creating event network-vif-plugged:fc75dee7-62cc-4e1d-b6cb-1fc222e7d59c for instance 900f2c3c-cc61-4571-9b4e-d60c85c7daa8 on hv-cinder-82497 Jan 28 02:14:44.512553 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [req-516d3a64-b347-4466-9a8b-31a1be8228af req-95461075-3bf0-4f42-a4b4-1659c1b5b036 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032005 Jan 28 02:14:44.513689 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 552/1148] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Jan 28 02:14:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:14:44.518642 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-bea4bab7-0979-4f52-b80c-c99dfc49277a tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:14:44.519419 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-bea4bab7-0979-4f52-b80c-c99dfc49277a tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] [instance: 678b2127-dbf6-4985-93ba-1171bae26d88] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:14:44.529121 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-bea4bab7-0979-4f52-b80c-c99dfc49277a tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:44.529572 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-bea4bab7-0979-4f52-b80c-c99dfc49277a tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:44.530348 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-bea4bab7-0979-4f52-b80c-c99dfc49277a tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:44.530783 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-bea4bab7-0979-4f52-b80c-c99dfc49277a tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:44.607237 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-bea4bab7-0979-4f52-b80c-c99dfc49277a tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cdbf7d369e4437eae7a36529d6cd623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed8db325d13496c9a417966e33b10a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:14:44.627947 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-bea4bab7-0979-4f52-b80c-c99dfc49277a tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] 10.222.0.79 "GET /compute/v2.1/servers/678b2127-dbf6-4985-93ba-1171bae26d88" status: 200 len: 1143 microversion: 2.1 time: 0.103496 Jan 28 02:14:44.627947 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 597/1149] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:14:44 2022] GET /compute/v2.1/servers/678b2127-dbf6-4985-93ba-1171bae26d88 => generated 1143 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:14:44.880482 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-f9fdf4ca-449b-4e9a-a91f-b4122729ffae tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:14:44.881479 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-f9fdf4ca-449b-4e9a-a91f-b4122729ffae tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] [instance: 900f2c3c-cc61-4571-9b4e-d60c85c7daa8] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:14:44.887848 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f9fdf4ca-449b-4e9a-a91f-b4122729ffae tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:44.888323 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f9fdf4ca-449b-4e9a-a91f-b4122729ffae tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:44.889299 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f9fdf4ca-449b-4e9a-a91f-b4122729ffae tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:44.889643 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f9fdf4ca-449b-4e9a-a91f-b4122729ffae tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:45.068621 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-f9fdf4ca-449b-4e9a-a91f-b4122729ffae tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a44eea6c44247d0a40f007026b1fb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfdaf77bcf5a4358b657de79f178fa6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:14:45.075802 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-f9fdf4ca-449b-4e9a-a91f-b4122729ffae tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] 10.222.0.79 "GET /compute/v2.1/servers/900f2c3c-cc61-4571-9b4e-d60c85c7daa8" status: 200 len: 1319 microversion: 2.1 time: 0.199530 Jan 28 02:14:45.076408 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 553/1150] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:14:44 2022] GET /compute/v2.1/servers/900f2c3c-cc61-4571-9b4e-d60c85c7daa8 => generated 1319 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:14:45.242705 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [req-503c863d-2185-4cca-8aba-7cc9bba41574 req-2ac7475b-da17-4cb9-973c-50d6409e2044 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b886ef6-6c08-4ed8-9d10-35c49c2c6382", "tag": "7b4575d4-25de-48a0-8c88-24340312c99a"}]} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:14:45.248410 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-73d91459-81b0-4189-8b50-85d28b6c5ac4 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:14:45.248410 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-73d91459-81b0-4189-8b50-85d28b6c5ac4 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] [instance: 9b886ef6-6c08-4ed8-9d10-35c49c2c6382] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:14:45.248644 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:14:45.248644 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: warnings.warn(msg) Jan 28 02:14:45.251760 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-73d91459-81b0-4189-8b50-85d28b6c5ac4 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:45.252430 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-73d91459-81b0-4189-8b50-85d28b6c5ac4 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:45.253208 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-73d91459-81b0-4189-8b50-85d28b6c5ac4 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:45.253630 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-73d91459-81b0-4189-8b50-85d28b6c5ac4 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:45.255600 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-503c863d-2185-4cca-8aba-7cc9bba41574 req-2ac7475b-da17-4cb9-973c-50d6409e2044 service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:45.256093 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-503c863d-2185-4cca-8aba-7cc9bba41574 req-2ac7475b-da17-4cb9-973c-50d6409e2044 service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:45.267786 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.compute.server_external_events [req-503c863d-2185-4cca-8aba-7cc9bba41574 req-2ac7475b-da17-4cb9-973c-50d6409e2044 service nova] Creating event network-changed:7b4575d4-25de-48a0-8c88-24340312c99a for instance 9b886ef6-6c08-4ed8-9d10-35c49c2c6382 on hv-cinder-82497 Jan 28 02:14:45.273485 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [req-503c863d-2185-4cca-8aba-7cc9bba41574 req-2ac7475b-da17-4cb9-973c-50d6409e2044 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035937 Jan 28 02:14:45.274257 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 554/1151] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Jan 28 02:14:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:14:45.280016 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-73d91459-81b0-4189-8b50-85d28b6c5ac4 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] [instance: 9b886ef6-6c08-4ed8-9d10-35c49c2c6382] Going to try to terminate instance {{(pid=116374) delete /opt/stack/nova/nova/compute/api.py:2612}} Jan 28 02:14:45.398746 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-83e7ea15-1f76-4997-9c48-997d7ceb073c tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:14:45.399824 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-83e7ea15-1f76-4997-9c48-997d7ceb073c tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] [instance: 78b24526-46a7-4507-90e0-1273ba252135] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:14:45.405735 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-83e7ea15-1f76-4997-9c48-997d7ceb073c tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:45.406172 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-83e7ea15-1f76-4997-9c48-997d7ceb073c tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:45.408719 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-83e7ea15-1f76-4997-9c48-997d7ceb073c tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:45.408719 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-83e7ea15-1f76-4997-9c48-997d7ceb073c tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:45.607227 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-73d91459-81b0-4189-8b50-85d28b6c5ac4 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] 10.222.0.79 "DELETE /compute/v2.1/servers/9b886ef6-6c08-4ed8-9d10-35c49c2c6382" status: 204 len: 0 microversion: 2.1 time: 0.372371 Jan 28 02:14:45.607986 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 598/1152] 10.222.0.79 () {58 vars in 1238 bytes} [Fri Jan 28 02:14:45 2022] DELETE /compute/v2.1/servers/9b886ef6-6c08-4ed8-9d10-35c49c2c6382 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 28 02:14:45.620961 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-68c939c1-ed57-4a47-a90e-833e47da8494 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:14:45.626680 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-83e7ea15-1f76-4997-9c48-997d7ceb073c tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45e3859fd364a48b40248e2a383121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e977ea9e1f45ddbba1e5cfc40616be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:14:45.627427 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-68c939c1-ed57-4a47-a90e-833e47da8494 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] [instance: 9b886ef6-6c08-4ed8-9d10-35c49c2c6382] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:14:45.634543 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-83e7ea15-1f76-4997-9c48-997d7ceb073c tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] 10.222.0.79 "GET /compute/v2.1/servers/78b24526-46a7-4507-90e0-1273ba252135" status: 200 len: 1313 microversion: 2.1 time: 0.240455 Jan 28 02:14:45.635327 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 555/1153] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:14:45 2022] GET /compute/v2.1/servers/78b24526-46a7-4507-90e0-1273ba252135 => generated 1313 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:14:45.639190 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-68c939c1-ed57-4a47-a90e-833e47da8494 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:45.640356 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-68c939c1-ed57-4a47-a90e-833e47da8494 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:45.640950 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-b74acbf0-3d5c-40a6-96d3-3a1b7be3107b tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:14:45.641731 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-b74acbf0-3d5c-40a6-96d3-3a1b7be3107b tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] [instance: 678b2127-dbf6-4985-93ba-1171bae26d88] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:14:45.642233 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-68c939c1-ed57-4a47-a90e-833e47da8494 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:45.642766 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-68c939c1-ed57-4a47-a90e-833e47da8494 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:45.654941 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b74acbf0-3d5c-40a6-96d3-3a1b7be3107b tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:45.654941 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b74acbf0-3d5c-40a6-96d3-3a1b7be3107b tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:45.654941 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b74acbf0-3d5c-40a6-96d3-3a1b7be3107b tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:45.654941 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b74acbf0-3d5c-40a6-96d3-3a1b7be3107b tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:45.729712 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-b74acbf0-3d5c-40a6-96d3-3a1b7be3107b tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cdbf7d369e4437eae7a36529d6cd623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed8db325d13496c9a417966e33b10a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:14:45.739071 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-b74acbf0-3d5c-40a6-96d3-3a1b7be3107b tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] 10.222.0.79 "GET /compute/v2.1/servers/678b2127-dbf6-4985-93ba-1171bae26d88" status: 200 len: 1191 microversion: 2.1 time: 0.102355 Jan 28 02:14:45.741073 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 556/1154] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:14:45 2022] GET /compute/v2.1/servers/678b2127-dbf6-4985-93ba-1171bae26d88 => generated 1191 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:14:46.037653 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-68c939c1-ed57-4a47-a90e-833e47da8494 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5c39b83f31473696c9b249ab49d780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55dde8892fa47bd9941bb1ce9aa3673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:14:46.045734 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-68c939c1-ed57-4a47-a90e-833e47da8494 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] 10.222.0.79 "GET /compute/v2.1/servers/9b886ef6-6c08-4ed8-9d10-35c49c2c6382" status: 200 len: 1568 microversion: 2.1 time: 0.432711 Jan 28 02:14:46.046414 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 599/1155] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:14:45 2022] GET /compute/v2.1/servers/9b886ef6-6c08-4ed8-9d10-35c49c2c6382 => generated 1568 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:14:46.094726 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-9df65d6e-a6ec-45f4-9843-5c7c7ae01407 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:14:46.095336 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-9df65d6e-a6ec-45f4-9843-5c7c7ae01407 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] [instance: 900f2c3c-cc61-4571-9b4e-d60c85c7daa8] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:14:46.103390 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-9df65d6e-a6ec-45f4-9843-5c7c7ae01407 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:46.103801 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-9df65d6e-a6ec-45f4-9843-5c7c7ae01407 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:46.113020 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-9df65d6e-a6ec-45f4-9843-5c7c7ae01407 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:46.113485 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-9df65d6e-a6ec-45f4-9843-5c7c7ae01407 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:46.498932 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-9df65d6e-a6ec-45f4-9843-5c7c7ae01407 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a44eea6c44247d0a40f007026b1fb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfdaf77bcf5a4358b657de79f178fa6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:14:46.506982 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-9df65d6e-a6ec-45f4-9843-5c7c7ae01407 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] 10.222.0.79 "GET /compute/v2.1/servers/900f2c3c-cc61-4571-9b4e-d60c85c7daa8" status: 200 len: 1319 microversion: 2.1 time: 0.417248 Jan 28 02:14:46.510297 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 557/1156] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:14:46 2022] GET /compute/v2.1/servers/900f2c3c-cc61-4571-9b4e-d60c85c7daa8 => generated 1319 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:14:46.651355 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-4e2d67b7-3591-431b-8865-22aa41242372 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:14:46.651954 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-4e2d67b7-3591-431b-8865-22aa41242372 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] [instance: 78b24526-46a7-4507-90e0-1273ba252135] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:14:46.658155 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-4e2d67b7-3591-431b-8865-22aa41242372 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:46.658614 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-4e2d67b7-3591-431b-8865-22aa41242372 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:46.659395 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-4e2d67b7-3591-431b-8865-22aa41242372 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:46.659822 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-4e2d67b7-3591-431b-8865-22aa41242372 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:46.768002 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-60e25bed-880a-47a8-b5d5-fc3a20a58630 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:14:46.768798 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-60e25bed-880a-47a8-b5d5-fc3a20a58630 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] [instance: 678b2127-dbf6-4985-93ba-1171bae26d88] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:14:46.775755 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-60e25bed-880a-47a8-b5d5-fc3a20a58630 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:46.776255 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-60e25bed-880a-47a8-b5d5-fc3a20a58630 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:46.777029 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-60e25bed-880a-47a8-b5d5-fc3a20a58630 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:46.777459 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-60e25bed-880a-47a8-b5d5-fc3a20a58630 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:46.856987 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-60e25bed-880a-47a8-b5d5-fc3a20a58630 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cdbf7d369e4437eae7a36529d6cd623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed8db325d13496c9a417966e33b10a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:14:46.864145 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-60e25bed-880a-47a8-b5d5-fc3a20a58630 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] 10.222.0.79 "GET /compute/v2.1/servers/678b2127-dbf6-4985-93ba-1171bae26d88" status: 200 len: 1209 microversion: 2.1 time: 0.110435 Jan 28 02:14:46.864919 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 558/1157] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:14:46 2022] GET /compute/v2.1/servers/678b2127-dbf6-4985-93ba-1171bae26d88 => generated 1209 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:14:46.904444 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-4e2d67b7-3591-431b-8865-22aa41242372 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45e3859fd364a48b40248e2a383121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e977ea9e1f45ddbba1e5cfc40616be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:14:46.911719 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-4e2d67b7-3591-431b-8865-22aa41242372 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] 10.222.0.79 "GET /compute/v2.1/servers/78b24526-46a7-4507-90e0-1273ba252135" status: 200 len: 1313 microversion: 2.1 time: 0.264120 Jan 28 02:14:46.912552 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 600/1158] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:14:46 2022] GET /compute/v2.1/servers/78b24526-46a7-4507-90e0-1273ba252135 => generated 1313 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:14:47.064292 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-6ba9eacf-e3dc-4c1b-9060-a0d5b4eb798b tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:14:47.064900 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-6ba9eacf-e3dc-4c1b-9060-a0d5b4eb798b tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] [instance: 9b886ef6-6c08-4ed8-9d10-35c49c2c6382] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:14:47.071461 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-6ba9eacf-e3dc-4c1b-9060-a0d5b4eb798b tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:47.071907 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-6ba9eacf-e3dc-4c1b-9060-a0d5b4eb798b tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:47.072692 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-6ba9eacf-e3dc-4c1b-9060-a0d5b4eb798b tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:47.073323 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-6ba9eacf-e3dc-4c1b-9060-a0d5b4eb798b tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:47.275680 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-6ba9eacf-e3dc-4c1b-9060-a0d5b4eb798b tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5c39b83f31473696c9b249ab49d780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55dde8892fa47bd9941bb1ce9aa3673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:14:47.283450 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-6ba9eacf-e3dc-4c1b-9060-a0d5b4eb798b tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] 10.222.0.79 "GET /compute/v2.1/servers/9b886ef6-6c08-4ed8-9d10-35c49c2c6382" status: 200 len: 1449 microversion: 2.1 time: 0.222801 Jan 28 02:14:47.284373 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 559/1159] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:14:47 2022] GET /compute/v2.1/servers/9b886ef6-6c08-4ed8-9d10-35c49c2c6382 => generated 1449 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:14:47.524485 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-28c78a04-f2ed-49a3-8a52-45cd6f8a3f5b tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:14:47.525194 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-28c78a04-f2ed-49a3-8a52-45cd6f8a3f5b tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] [instance: 900f2c3c-cc61-4571-9b4e-d60c85c7daa8] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:14:47.530985 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-28c78a04-f2ed-49a3-8a52-45cd6f8a3f5b tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:47.531517 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-28c78a04-f2ed-49a3-8a52-45cd6f8a3f5b tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:47.532374 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-28c78a04-f2ed-49a3-8a52-45cd6f8a3f5b tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:47.532810 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-28c78a04-f2ed-49a3-8a52-45cd6f8a3f5b tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:47.718977 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-28c78a04-f2ed-49a3-8a52-45cd6f8a3f5b tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a44eea6c44247d0a40f007026b1fb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfdaf77bcf5a4358b657de79f178fa6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:14:47.727145 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-28c78a04-f2ed-49a3-8a52-45cd6f8a3f5b tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] 10.222.0.79 "GET /compute/v2.1/servers/900f2c3c-cc61-4571-9b4e-d60c85c7daa8" status: 200 len: 1508 microversion: 2.1 time: 0.206924 Jan 28 02:14:47.727697 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 601/1160] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:14:47 2022] GET /compute/v2.1/servers/900f2c3c-cc61-4571-9b4e-d60c85c7daa8 => generated 1508 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:14:47.881379 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-85b29fa0-e23f-45ec-a253-4009f7f25f09 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:14:47.881992 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-85b29fa0-e23f-45ec-a253-4009f7f25f09 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] [instance: 678b2127-dbf6-4985-93ba-1171bae26d88] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:14:47.887832 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-85b29fa0-e23f-45ec-a253-4009f7f25f09 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:47.888406 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-85b29fa0-e23f-45ec-a253-4009f7f25f09 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:47.889256 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-85b29fa0-e23f-45ec-a253-4009f7f25f09 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:47.889678 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-85b29fa0-e23f-45ec-a253-4009f7f25f09 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:47.927832 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-b97eca07-4d9e-4c56-b87c-1f24ea596175 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:14:47.928768 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-b97eca07-4d9e-4c56-b87c-1f24ea596175 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] [instance: 78b24526-46a7-4507-90e0-1273ba252135] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:14:47.936137 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-b97eca07-4d9e-4c56-b87c-1f24ea596175 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:47.937040 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-b97eca07-4d9e-4c56-b87c-1f24ea596175 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:47.938329 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-b97eca07-4d9e-4c56-b87c-1f24ea596175 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:47.938811 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-b97eca07-4d9e-4c56-b87c-1f24ea596175 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:48.274372 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-85b29fa0-e23f-45ec-a253-4009f7f25f09 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cdbf7d369e4437eae7a36529d6cd623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed8db325d13496c9a417966e33b10a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:14:48.281633 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-85b29fa0-e23f-45ec-a253-4009f7f25f09 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] 10.222.0.79 "GET /compute/v2.1/servers/678b2127-dbf6-4985-93ba-1171bae26d88" status: 200 len: 1276 microversion: 2.1 time: 0.404060 Jan 28 02:14:48.282401 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 560/1161] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:14:47 2022] GET /compute/v2.1/servers/678b2127-dbf6-4985-93ba-1171bae26d88 => generated 1276 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:14:48.302760 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-0d6e104f-1897-4757-91e4-e32b22cf1cb7 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:14:48.303359 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-0d6e104f-1897-4757-91e4-e32b22cf1cb7 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] [instance: 9b886ef6-6c08-4ed8-9d10-35c49c2c6382] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:14:48.310463 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-0d6e104f-1897-4757-91e4-e32b22cf1cb7 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:48.310910 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-0d6e104f-1897-4757-91e4-e32b22cf1cb7 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:48.311682 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-0d6e104f-1897-4757-91e4-e32b22cf1cb7 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:48.312149 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-0d6e104f-1897-4757-91e4-e32b22cf1cb7 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:48.341676 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-b97eca07-4d9e-4c56-b87c-1f24ea596175 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45e3859fd364a48b40248e2a383121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e977ea9e1f45ddbba1e5cfc40616be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:14:48.350754 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-b97eca07-4d9e-4c56-b87c-1f24ea596175 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] 10.222.0.79 "GET /compute/v2.1/servers/78b24526-46a7-4507-90e0-1273ba252135" status: 200 len: 1313 microversion: 2.1 time: 0.427002 Jan 28 02:14:48.353416 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 602/1162] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:14:47 2022] GET /compute/v2.1/servers/78b24526-46a7-4507-90e0-1273ba252135 => generated 1313 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:14:48.558615 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [req-5700107f-7989-49cd-a61c-2a373461241c req-75b7e384-0b84-495e-ab6d-efe72dd19f70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78b24526-46a7-4507-90e0-1273ba252135", "name": "network-vif-plugged", "status": "completed", "tag": "0fe5e297-3f96-48a7-a35a-88d100e855c5"}]} {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:14:48.560224 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:14:48.560224 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: warnings.warn(msg) Jan 28 02:14:48.567911 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [req-5700107f-7989-49cd-a61c-2a373461241c req-75b7e384-0b84-495e-ab6d-efe72dd19f70 service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:48.568377 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [req-5700107f-7989-49cd-a61c-2a373461241c req-75b7e384-0b84-495e-ab6d-efe72dd19f70 service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:48.584294 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.compute.server_external_events [req-5700107f-7989-49cd-a61c-2a373461241c req-75b7e384-0b84-495e-ab6d-efe72dd19f70 service nova] Creating event network-vif-plugged:0fe5e297-3f96-48a7-a35a-88d100e855c5 for instance 78b24526-46a7-4507-90e0-1273ba252135 on hv-cinder-82497 Jan 28 02:14:48.589341 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [req-5700107f-7989-49cd-a61c-2a373461241c req-75b7e384-0b84-495e-ab6d-efe72dd19f70 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034303 Jan 28 02:14:48.592217 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 603/1163] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Jan 28 02:14:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 02:14:48.592510 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-0d6e104f-1897-4757-91e4-e32b22cf1cb7 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5c39b83f31473696c9b249ab49d780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55dde8892fa47bd9941bb1ce9aa3673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:14:48.600250 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-0d6e104f-1897-4757-91e4-e32b22cf1cb7 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] 10.222.0.79 "GET /compute/v2.1/servers/9b886ef6-6c08-4ed8-9d10-35c49c2c6382" status: 200 len: 1449 microversion: 2.1 time: 0.301959 Jan 28 02:14:48.600838 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 561/1164] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:14:48 2022] GET /compute/v2.1/servers/9b886ef6-6c08-4ed8-9d10-35c49c2c6382 => generated 1449 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:14:48.758104 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [req-1e5b2dc5-ed96-412d-9946-e660cae22faf req-55592382-80ea-4348-9e83-5e3e771f32c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "678b2127-dbf6-4985-93ba-1171bae26d88", "tag": "41e411b1-116e-434d-a378-dd8425c82364"}]} {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:14:48.760368 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:14:48.760368 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: warnings.warn(msg) Jan 28 02:14:48.771144 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [req-1e5b2dc5-ed96-412d-9946-e660cae22faf req-55592382-80ea-4348-9e83-5e3e771f32c4 service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:48.771898 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [req-1e5b2dc5-ed96-412d-9946-e660cae22faf req-55592382-80ea-4348-9e83-5e3e771f32c4 service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:48.789517 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.compute.server_external_events [req-1e5b2dc5-ed96-412d-9946-e660cae22faf req-55592382-80ea-4348-9e83-5e3e771f32c4 service nova] Creating event network-changed:41e411b1-116e-434d-a378-dd8425c82364 for instance 678b2127-dbf6-4985-93ba-1171bae26d88 on hv-cinder-82497 Jan 28 02:14:48.794856 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [req-1e5b2dc5-ed96-412d-9946-e660cae22faf req-55592382-80ea-4348-9e83-5e3e771f32c4 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040713 Jan 28 02:14:48.795718 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 604/1165] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Jan 28 02:14:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:14:49.298633 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-2bb71814-549b-4574-be8d-c1c4b389a898 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:14:49.299242 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-2bb71814-549b-4574-be8d-c1c4b389a898 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] [instance: 678b2127-dbf6-4985-93ba-1171bae26d88] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:14:49.306363 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2bb71814-549b-4574-be8d-c1c4b389a898 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:49.306809 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2bb71814-549b-4574-be8d-c1c4b389a898 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:49.307583 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2bb71814-549b-4574-be8d-c1c4b389a898 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:49.308032 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2bb71814-549b-4574-be8d-c1c4b389a898 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:49.368303 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-486a14c1-770f-4da2-a23f-2c953f59a70a tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:14:49.369032 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-486a14c1-770f-4da2-a23f-2c953f59a70a tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] [instance: 78b24526-46a7-4507-90e0-1273ba252135] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:14:49.375630 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-486a14c1-770f-4da2-a23f-2c953f59a70a tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:49.376150 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-486a14c1-770f-4da2-a23f-2c953f59a70a tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:49.377053 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-486a14c1-770f-4da2-a23f-2c953f59a70a tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:49.377528 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-486a14c1-770f-4da2-a23f-2c953f59a70a tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:49.463850 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-2bb71814-549b-4574-be8d-c1c4b389a898 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cdbf7d369e4437eae7a36529d6cd623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed8db325d13496c9a417966e33b10a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:14:49.472192 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-2bb71814-549b-4574-be8d-c1c4b389a898 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] 10.222.0.79 "GET /compute/v2.1/servers/678b2127-dbf6-4985-93ba-1171bae26d88" status: 200 len: 1264 microversion: 2.1 time: 0.177056 Jan 28 02:14:49.474595 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 562/1166] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:14:49 2022] GET /compute/v2.1/servers/678b2127-dbf6-4985-93ba-1171bae26d88 => generated 1264 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:14:49.557565 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-486a14c1-770f-4da2-a23f-2c953f59a70a tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45e3859fd364a48b40248e2a383121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e977ea9e1f45ddbba1e5cfc40616be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:14:49.564928 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-486a14c1-770f-4da2-a23f-2c953f59a70a tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] 10.222.0.79 "GET /compute/v2.1/servers/78b24526-46a7-4507-90e0-1273ba252135" status: 200 len: 1313 microversion: 2.1 time: 0.200844 Jan 28 02:14:49.565491 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 605/1167] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:14:49 2022] GET /compute/v2.1/servers/78b24526-46a7-4507-90e0-1273ba252135 => generated 1313 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:14:49.617578 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-fe073bf2-20f8-407d-adc8-130b64f27371 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:14:49.618188 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-fe073bf2-20f8-407d-adc8-130b64f27371 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] [instance: 9b886ef6-6c08-4ed8-9d10-35c49c2c6382] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:14:49.624196 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-fe073bf2-20f8-407d-adc8-130b64f27371 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:49.624650 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-fe073bf2-20f8-407d-adc8-130b64f27371 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:49.625418 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-fe073bf2-20f8-407d-adc8-130b64f27371 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:49.625856 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-fe073bf2-20f8-407d-adc8-130b64f27371 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:49.707116 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-fe073bf2-20f8-407d-adc8-130b64f27371 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5c39b83f31473696c9b249ab49d780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55dde8892fa47bd9941bb1ce9aa3673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:14:49.717867 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-fe073bf2-20f8-407d-adc8-130b64f27371 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] 10.222.0.79 "GET /compute/v2.1/servers/9b886ef6-6c08-4ed8-9d10-35c49c2c6382" status: 200 len: 1219 microversion: 2.1 time: 0.104359 Jan 28 02:14:49.718573 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 563/1168] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:14:49 2022] GET /compute/v2.1/servers/9b886ef6-6c08-4ed8-9d10-35c49c2c6382 => generated 1219 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:14:50.491938 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-1d3e0e86-f271-495f-8ec0-b460fa24e761 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:14:50.492638 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-1d3e0e86-f271-495f-8ec0-b460fa24e761 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] [instance: 678b2127-dbf6-4985-93ba-1171bae26d88] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:14:50.498508 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-1d3e0e86-f271-495f-8ec0-b460fa24e761 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:50.501006 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-1d3e0e86-f271-495f-8ec0-b460fa24e761 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:50.501006 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-1d3e0e86-f271-495f-8ec0-b460fa24e761 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:50.501006 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-1d3e0e86-f271-495f-8ec0-b460fa24e761 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:50.586883 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-e748594c-f577-40da-9b9c-c8409a8f1d2c tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:14:50.588877 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-e748594c-f577-40da-9b9c-c8409a8f1d2c tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] [instance: 78b24526-46a7-4507-90e0-1273ba252135] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:14:50.595324 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-e748594c-f577-40da-9b9c-c8409a8f1d2c tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:50.601774 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-e748594c-f577-40da-9b9c-c8409a8f1d2c tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:50.601774 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-e748594c-f577-40da-9b9c-c8409a8f1d2c tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:50.601774 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-e748594c-f577-40da-9b9c-c8409a8f1d2c tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:50.647759 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-1d3e0e86-f271-495f-8ec0-b460fa24e761 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cdbf7d369e4437eae7a36529d6cd623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed8db325d13496c9a417966e33b10a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:14:50.655468 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-1d3e0e86-f271-495f-8ec0-b460fa24e761 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] 10.222.0.79 "GET /compute/v2.1/servers/678b2127-dbf6-4985-93ba-1171bae26d88" status: 200 len: 1264 microversion: 2.1 time: 0.167466 Jan 28 02:14:50.656389 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 606/1169] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:14:50 2022] GET /compute/v2.1/servers/678b2127-dbf6-4985-93ba-1171bae26d88 => generated 1264 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:14:50.735118 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-3bda6669-52ed-4758-847c-0b7ddb90d618 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:14:50.735844 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-3bda6669-52ed-4758-847c-0b7ddb90d618 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] [instance: 9b886ef6-6c08-4ed8-9d10-35c49c2c6382] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:14:50.745346 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-3bda6669-52ed-4758-847c-0b7ddb90d618 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:50.745544 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-e748594c-f577-40da-9b9c-c8409a8f1d2c tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45e3859fd364a48b40248e2a383121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e977ea9e1f45ddbba1e5cfc40616be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:14:50.745954 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-3bda6669-52ed-4758-847c-0b7ddb90d618 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:50.746810 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-3bda6669-52ed-4758-847c-0b7ddb90d618 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:50.747416 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-3bda6669-52ed-4758-847c-0b7ddb90d618 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:50.753370 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-e748594c-f577-40da-9b9c-c8409a8f1d2c tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] 10.222.0.79 "GET /compute/v2.1/servers/78b24526-46a7-4507-90e0-1273ba252135" status: 200 len: 1313 microversion: 2.1 time: 0.173874 Jan 28 02:14:50.753983 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 564/1170] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:14:50 2022] GET /compute/v2.1/servers/78b24526-46a7-4507-90e0-1273ba252135 => generated 1313 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:14:50.778332 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-3bda6669-52ed-4758-847c-0b7ddb90d618 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:50.778780 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-3bda6669-52ed-4758-847c-0b7ddb90d618 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:50.779237 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.objects.instance [None req-3bda6669-52ed-4758-847c-0b7ddb90d618 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lazy-loading 'fault' on Instance uuid 9b886ef6-6c08-4ed8-9d10-35c49c2c6382 {{(pid=116374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jan 28 02:14:50.818578 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [req-5264d430-be12-4374-880b-d5cbfeef5da8 req-dce8bcc2-1902-44f2-9956-e98ea3344ab2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b886ef6-6c08-4ed8-9d10-35c49c2c6382", "name": "network-vif-deleted", "tag": "7b4575d4-25de-48a0-8c88-24340312c99a"}]} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:14:50.820598 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:14:50.820598 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: warnings.warn(msg) Jan 28 02:14:50.827469 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-5264d430-be12-4374-880b-d5cbfeef5da8 req-dce8bcc2-1902-44f2-9956-e98ea3344ab2 service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:50.828324 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-5264d430-be12-4374-880b-d5cbfeef5da8 req-dce8bcc2-1902-44f2-9956-e98ea3344ab2 service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:50.833297 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-3bda6669-52ed-4758-847c-0b7ddb90d618 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb5c39b83f31473696c9b249ab49d780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a55dde8892fa47bd9941bb1ce9aa3673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:14:50.841982 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-3bda6669-52ed-4758-847c-0b7ddb90d618 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] 10.222.0.79 "GET /compute/v2.1/servers/9b886ef6-6c08-4ed8-9d10-35c49c2c6382" status: 200 len: 1224 microversion: 2.1 time: 0.110663 Jan 28 02:14:50.847752 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 607/1171] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:14:50 2022] GET /compute/v2.1/servers/9b886ef6-6c08-4ed8-9d10-35c49c2c6382 => generated 1224 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:14:50.847879 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.compute.server_external_events [req-5264d430-be12-4374-880b-d5cbfeef5da8 req-dce8bcc2-1902-44f2-9956-e98ea3344ab2 service nova] Creating event network-vif-deleted:7b4575d4-25de-48a0-8c88-24340312c99a for instance 9b886ef6-6c08-4ed8-9d10-35c49c2c6382 on hv-cinder-82497 Jan 28 02:14:50.850080 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [req-5264d430-be12-4374-880b-d5cbfeef5da8 req-dce8bcc2-1902-44f2-9956-e98ea3344ab2 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035162 Jan 28 02:14:50.850796 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 565/1172] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Jan 28 02:14:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:14:51.673059 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-c740b293-e43d-4b71-83c0-94a4e95bf3f0 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:14:51.673662 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-c740b293-e43d-4b71-83c0-94a4e95bf3f0 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] [instance: 678b2127-dbf6-4985-93ba-1171bae26d88] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:14:51.679605 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-c740b293-e43d-4b71-83c0-94a4e95bf3f0 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:51.680091 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-c740b293-e43d-4b71-83c0-94a4e95bf3f0 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:51.680862 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-c740b293-e43d-4b71-83c0-94a4e95bf3f0 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:51.681302 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-c740b293-e43d-4b71-83c0-94a4e95bf3f0 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:51.771279 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-02f14f92-a149-4c05-8772-7e5c4e93018b tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:14:51.771961 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-02f14f92-a149-4c05-8772-7e5c4e93018b tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] [instance: 78b24526-46a7-4507-90e0-1273ba252135] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:14:51.777754 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-02f14f92-a149-4c05-8772-7e5c4e93018b tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:51.778285 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-02f14f92-a149-4c05-8772-7e5c4e93018b tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:51.779208 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-02f14f92-a149-4c05-8772-7e5c4e93018b tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:51.779723 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-02f14f92-a149-4c05-8772-7e5c4e93018b tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:51.803497 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-c740b293-e43d-4b71-83c0-94a4e95bf3f0 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cdbf7d369e4437eae7a36529d6cd623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed8db325d13496c9a417966e33b10a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:14:51.810883 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-c740b293-e43d-4b71-83c0-94a4e95bf3f0 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] 10.222.0.79 "GET /compute/v2.1/servers/678b2127-dbf6-4985-93ba-1171bae26d88" status: 200 len: 1264 microversion: 2.1 time: 0.141593 Jan 28 02:14:51.811446 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 608/1173] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:14:51 2022] GET /compute/v2.1/servers/678b2127-dbf6-4985-93ba-1171bae26d88 => generated 1264 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:14:51.862819 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-2a47a876-9466-4771-b92d-38a038203ec8 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:14:51.863960 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-2a47a876-9466-4771-b92d-38a038203ec8 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] [instance: 9b886ef6-6c08-4ed8-9d10-35c49c2c6382] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:14:51.872170 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-2a47a876-9466-4771-b92d-38a038203ec8 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:51.872721 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-2a47a876-9466-4771-b92d-38a038203ec8 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:51.873657 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-2a47a876-9466-4771-b92d-38a038203ec8 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:51.874271 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-2a47a876-9466-4771-b92d-38a038203ec8 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:51.888857 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.wsgi [None req-2a47a876-9466-4771-b92d-38a038203ec8 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] HTTP exception thrown: Instance 9b886ef6-6c08-4ed8-9d10-35c49c2c6382 could not be found. Jan 28 02:14:51.889565 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-2a47a876-9466-4771-b92d-38a038203ec8 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Returning 404 to user: Instance 9b886ef6-6c08-4ed8-9d10-35c49c2c6382 could not be found. {{(pid=116374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 02:14:51.890493 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-2a47a876-9466-4771-b92d-38a038203ec8 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] 10.222.0.79 "GET /compute/v2.1/servers/9b886ef6-6c08-4ed8-9d10-35c49c2c6382" status: 404 len: 111 microversion: 2.1 time: 0.031818 Jan 28 02:14:51.892053 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 609/1174] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:14:51 2022] GET /compute/v2.1/servers/9b886ef6-6c08-4ed8-9d10-35c49c2c6382 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 28 02:14:51.908618 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-02f14f92-a149-4c05-8772-7e5c4e93018b tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45e3859fd364a48b40248e2a383121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e977ea9e1f45ddbba1e5cfc40616be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:14:51.917599 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-02f14f92-a149-4c05-8772-7e5c4e93018b tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] 10.222.0.79 "GET /compute/v2.1/servers/78b24526-46a7-4507-90e0-1273ba252135" status: 200 len: 1497 microversion: 2.1 time: 0.150663 Jan 28 02:14:51.918725 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 566/1175] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:14:51 2022] GET /compute/v2.1/servers/78b24526-46a7-4507-90e0-1273ba252135 => generated 1497 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:14:52.162147 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-82648d52-7b6f-460e-a418-bb75276855b5 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] Calling method '.version_select at 0x7f837c3b3e50>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:14:52.323433 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-82648d52-7b6f-460e-a418-bb75276855b5 tempest-TestShelveInstance-967642037 tempest-TestShelveInstance-967642037-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-740833808" status: 202 len: 0 microversion: 2.1 time: 0.165929 Jan 28 02:14:52.324023 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 610/1176] 10.222.0.79 () {58 vars in 1250 bytes} [Fri Jan 28 02:14:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-740833808 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 28 02:14:52.826567 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-133af0e5-2d4b-4b05-9a98-bd0424bda987 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:14:52.827112 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-133af0e5-2d4b-4b05-9a98-bd0424bda987 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] [instance: 678b2127-dbf6-4985-93ba-1171bae26d88] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:14:52.833700 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-133af0e5-2d4b-4b05-9a98-bd0424bda987 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:52.834476 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-133af0e5-2d4b-4b05-9a98-bd0424bda987 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:52.835273 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-133af0e5-2d4b-4b05-9a98-bd0424bda987 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:52.835707 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-133af0e5-2d4b-4b05-9a98-bd0424bda987 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:52.972339 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-133af0e5-2d4b-4b05-9a98-bd0424bda987 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cdbf7d369e4437eae7a36529d6cd623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed8db325d13496c9a417966e33b10a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:14:52.980131 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-133af0e5-2d4b-4b05-9a98-bd0424bda987 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] 10.222.0.79 "GET /compute/v2.1/servers/678b2127-dbf6-4985-93ba-1171bae26d88" status: 200 len: 1264 microversion: 2.1 time: 0.157253 Jan 28 02:14:52.981533 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 567/1177] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:14:52 2022] GET /compute/v2.1/servers/678b2127-dbf6-4985-93ba-1171bae26d88 => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:14:52.987051 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-74683572-79f7-449f-8c11-c3e0e98cdc72 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:14:52.987737 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-74683572-79f7-449f-8c11-c3e0e98cdc72 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] [instance: 78b24526-46a7-4507-90e0-1273ba252135] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:14:52.994208 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-74683572-79f7-449f-8c11-c3e0e98cdc72 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:52.994856 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-74683572-79f7-449f-8c11-c3e0e98cdc72 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:52.995426 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-74683572-79f7-449f-8c11-c3e0e98cdc72 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:52.995858 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-74683572-79f7-449f-8c11-c3e0e98cdc72 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:53.025020 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-74683572-79f7-449f-8c11-c3e0e98cdc72 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] [instance: 78b24526-46a7-4507-90e0-1273ba252135] Going to try to terminate instance {{(pid=116374) delete /opt/stack/nova/nova/compute/api.py:2612}} Jan 28 02:14:53.361824 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-74683572-79f7-449f-8c11-c3e0e98cdc72 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] 10.222.0.79 "DELETE /compute/v2.1/servers/78b24526-46a7-4507-90e0-1273ba252135" status: 204 len: 0 microversion: 2.1 time: 0.378287 Jan 28 02:14:53.372795 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 611/1178] 10.222.0.79 () {58 vars in 1238 bytes} [Fri Jan 28 02:14:52 2022] DELETE /compute/v2.1/servers/78b24526-46a7-4507-90e0-1273ba252135 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 28 02:14:53.372937 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-b6047886-af67-4244-8024-737566711cfd tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:14:53.372937 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-b6047886-af67-4244-8024-737566711cfd tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] [instance: 78b24526-46a7-4507-90e0-1273ba252135] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:14:53.376941 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b6047886-af67-4244-8024-737566711cfd tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:53.377445 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b6047886-af67-4244-8024-737566711cfd tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:53.378135 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b6047886-af67-4244-8024-737566711cfd tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:53.378560 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b6047886-af67-4244-8024-737566711cfd tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:53.508100 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-b6047886-af67-4244-8024-737566711cfd tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45e3859fd364a48b40248e2a383121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e977ea9e1f45ddbba1e5cfc40616be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:14:53.512629 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-b6047886-af67-4244-8024-737566711cfd tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] 10.222.0.79 "GET /compute/v2.1/servers/78b24526-46a7-4507-90e0-1273ba252135" status: 200 len: 1503 microversion: 2.1 time: 0.145939 Jan 28 02:14:53.513411 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 568/1179] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:14:53 2022] GET /compute/v2.1/servers/78b24526-46a7-4507-90e0-1273ba252135 => generated 1503 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:14:53.997456 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-7a12aa0a-fbab-49eb-b5e4-6ad5a0c1c317 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:14:54.005951 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-7a12aa0a-fbab-49eb-b5e4-6ad5a0c1c317 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] [instance: 678b2127-dbf6-4985-93ba-1171bae26d88] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:14:54.005951 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-7a12aa0a-fbab-49eb-b5e4-6ad5a0c1c317 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:54.006363 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-7a12aa0a-fbab-49eb-b5e4-6ad5a0c1c317 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:54.007354 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-7a12aa0a-fbab-49eb-b5e4-6ad5a0c1c317 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:54.008683 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-7a12aa0a-fbab-49eb-b5e4-6ad5a0c1c317 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:54.134375 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-7a12aa0a-fbab-49eb-b5e4-6ad5a0c1c317 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cdbf7d369e4437eae7a36529d6cd623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed8db325d13496c9a417966e33b10a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:14:54.153257 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-7a12aa0a-fbab-49eb-b5e4-6ad5a0c1c317 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] 10.222.0.79 "GET /compute/v2.1/servers/678b2127-dbf6-4985-93ba-1171bae26d88" status: 200 len: 1264 microversion: 2.1 time: 0.159801 Jan 28 02:14:54.157422 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 612/1180] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:14:53 2022] GET /compute/v2.1/servers/678b2127-dbf6-4985-93ba-1171bae26d88 => generated 1264 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:14:54.533269 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-77c3cf35-60fe-41d6-ae9c-7cec8a52d842 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:14:54.533800 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-77c3cf35-60fe-41d6-ae9c-7cec8a52d842 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] [instance: 78b24526-46a7-4507-90e0-1273ba252135] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:14:54.539645 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-77c3cf35-60fe-41d6-ae9c-7cec8a52d842 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:54.540122 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-77c3cf35-60fe-41d6-ae9c-7cec8a52d842 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:54.541056 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-77c3cf35-60fe-41d6-ae9c-7cec8a52d842 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:54.541694 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-77c3cf35-60fe-41d6-ae9c-7cec8a52d842 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:54.775812 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-77c3cf35-60fe-41d6-ae9c-7cec8a52d842 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45e3859fd364a48b40248e2a383121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e977ea9e1f45ddbba1e5cfc40616be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:14:54.783731 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-77c3cf35-60fe-41d6-ae9c-7cec8a52d842 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] 10.222.0.79 "GET /compute/v2.1/servers/78b24526-46a7-4507-90e0-1273ba252135" status: 200 len: 1503 microversion: 2.1 time: 0.254164 Jan 28 02:14:54.784435 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 569/1181] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:14:54 2022] GET /compute/v2.1/servers/78b24526-46a7-4507-90e0-1273ba252135 => generated 1503 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:14:55.170466 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-1d74c6f6-aee1-4bdc-9309-8acdc9263bf3 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:14:55.173728 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-1d74c6f6-aee1-4bdc-9309-8acdc9263bf3 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] [instance: 678b2127-dbf6-4985-93ba-1171bae26d88] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:14:55.191045 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-1d74c6f6-aee1-4bdc-9309-8acdc9263bf3 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:55.191045 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-1d74c6f6-aee1-4bdc-9309-8acdc9263bf3 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:55.191045 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-1d74c6f6-aee1-4bdc-9309-8acdc9263bf3 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:55.191045 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-1d74c6f6-aee1-4bdc-9309-8acdc9263bf3 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:55.588992 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-1d74c6f6-aee1-4bdc-9309-8acdc9263bf3 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cdbf7d369e4437eae7a36529d6cd623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed8db325d13496c9a417966e33b10a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:14:55.598472 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-1d74c6f6-aee1-4bdc-9309-8acdc9263bf3 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] 10.222.0.79 "GET /compute/v2.1/servers/678b2127-dbf6-4985-93ba-1171bae26d88" status: 200 len: 1264 microversion: 2.1 time: 0.431561 Jan 28 02:14:55.604300 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 613/1182] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:14:55 2022] GET /compute/v2.1/servers/678b2127-dbf6-4985-93ba-1171bae26d88 => generated 1264 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:14:55.802601 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-509a32bc-d389-4a74-b803-f61c2ad10b78 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:14:55.803858 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-509a32bc-d389-4a74-b803-f61c2ad10b78 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] [instance: 78b24526-46a7-4507-90e0-1273ba252135] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:14:55.810819 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-509a32bc-d389-4a74-b803-f61c2ad10b78 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:55.811545 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-509a32bc-d389-4a74-b803-f61c2ad10b78 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:55.812551 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-509a32bc-d389-4a74-b803-f61c2ad10b78 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:55.813159 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-509a32bc-d389-4a74-b803-f61c2ad10b78 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:56.130530 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-509a32bc-d389-4a74-b803-f61c2ad10b78 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45e3859fd364a48b40248e2a383121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e977ea9e1f45ddbba1e5cfc40616be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:14:56.138498 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-509a32bc-d389-4a74-b803-f61c2ad10b78 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] 10.222.0.79 "GET /compute/v2.1/servers/78b24526-46a7-4507-90e0-1273ba252135" status: 200 len: 1503 microversion: 2.1 time: 0.340702 Jan 28 02:14:56.139655 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 570/1183] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:14:55 2022] GET /compute/v2.1/servers/78b24526-46a7-4507-90e0-1273ba252135 => generated 1503 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:14:56.449994 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [req-0ebad16b-b253-43b4-9b14-71aaffb36e33 req-9f3333cf-f768-45db-9a6c-5a1886c19071 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78b24526-46a7-4507-90e0-1273ba252135", "name": "network-vif-deleted", "tag": "0fe5e297-3f96-48a7-a35a-88d100e855c5"}]} {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:14:56.451480 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:14:56.451480 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: warnings.warn(msg) Jan 28 02:14:56.459426 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [req-0ebad16b-b253-43b4-9b14-71aaffb36e33 req-9f3333cf-f768-45db-9a6c-5a1886c19071 service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:56.463630 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [req-0ebad16b-b253-43b4-9b14-71aaffb36e33 req-9f3333cf-f768-45db-9a6c-5a1886c19071 service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:56.471575 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.compute.server_external_events [req-0ebad16b-b253-43b4-9b14-71aaffb36e33 req-9f3333cf-f768-45db-9a6c-5a1886c19071 service nova] Creating event network-vif-deleted:0fe5e297-3f96-48a7-a35a-88d100e855c5 for instance 78b24526-46a7-4507-90e0-1273ba252135 on hv-cinder-82497 Jan 28 02:14:56.477340 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [req-0ebad16b-b253-43b4-9b14-71aaffb36e33 req-9f3333cf-f768-45db-9a6c-5a1886c19071 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030916 Jan 28 02:14:56.478057 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 614/1184] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Jan 28 02:14:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 02:14:56.616434 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-87871c48-13de-4929-a1fd-8075e0332d62 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:14:56.617404 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-87871c48-13de-4929-a1fd-8075e0332d62 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] [instance: 678b2127-dbf6-4985-93ba-1171bae26d88] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:14:56.620112 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4f8f5c0c-1895-4e08-bc05-59f23e7b0545] AMQP server on 10.222.0.79:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jan 28 02:14:56.624830 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-87871c48-13de-4929-a1fd-8075e0332d62 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:56.625531 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-87871c48-13de-4929-a1fd-8075e0332d62 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:56.626537 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-87871c48-13de-4929-a1fd-8075e0332d62 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:56.627456 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-87871c48-13de-4929-a1fd-8075e0332d62 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:56.920669 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-87871c48-13de-4929-a1fd-8075e0332d62 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cdbf7d369e4437eae7a36529d6cd623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed8db325d13496c9a417966e33b10a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:14:56.930092 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-87871c48-13de-4929-a1fd-8075e0332d62 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] 10.222.0.79 "GET /compute/v2.1/servers/678b2127-dbf6-4985-93ba-1171bae26d88" status: 200 len: 1264 microversion: 2.1 time: 0.318354 Jan 28 02:14:56.930935 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 571/1185] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:14:56 2022] GET /compute/v2.1/servers/678b2127-dbf6-4985-93ba-1171bae26d88 => generated 1264 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:14:57.156802 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-1a8de2bc-278c-436a-8a93-cf5302463f46 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:14:57.157530 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-1a8de2bc-278c-436a-8a93-cf5302463f46 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] [instance: 78b24526-46a7-4507-90e0-1273ba252135] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:14:57.177565 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-1a8de2bc-278c-436a-8a93-cf5302463f46 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:57.182616 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-1a8de2bc-278c-436a-8a93-cf5302463f46 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:57.183445 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-1a8de2bc-278c-436a-8a93-cf5302463f46 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:57.184130 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-1a8de2bc-278c-436a-8a93-cf5302463f46 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:57.230874 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-1a8de2bc-278c-436a-8a93-cf5302463f46 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:57.231309 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-1a8de2bc-278c-436a-8a93-cf5302463f46 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:57.231699 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.objects.instance [None req-1a8de2bc-278c-436a-8a93-cf5302463f46 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Lazy-loading 'fault' on Instance uuid 78b24526-46a7-4507-90e0-1273ba252135 {{(pid=116374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jan 28 02:14:57.274417 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-1a8de2bc-278c-436a-8a93-cf5302463f46 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd45e3859fd364a48b40248e2a383121d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e977ea9e1f45ddbba1e5cfc40616be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:14:57.281621 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-1a8de2bc-278c-436a-8a93-cf5302463f46 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] 10.222.0.79 "GET /compute/v2.1/servers/78b24526-46a7-4507-90e0-1273ba252135" status: 200 len: 1303 microversion: 2.1 time: 0.128911 Jan 28 02:14:57.282173 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 615/1186] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:14:57 2022] GET /compute/v2.1/servers/78b24526-46a7-4507-90e0-1273ba252135 => generated 1303 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:14:57.947369 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-9b4d205c-983f-490f-8f9b-dca31cd4a2be tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:14:57.948145 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-9b4d205c-983f-490f-8f9b-dca31cd4a2be tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] [instance: 678b2127-dbf6-4985-93ba-1171bae26d88] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:14:57.958887 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-9b4d205c-983f-490f-8f9b-dca31cd4a2be tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:57.959328 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-9b4d205c-983f-490f-8f9b-dca31cd4a2be tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:57.960116 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-9b4d205c-983f-490f-8f9b-dca31cd4a2be tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:57.960542 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-9b4d205c-983f-490f-8f9b-dca31cd4a2be tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:57.965145 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO oslo.messaging._drivers.impl_rabbit [-] [4f8f5c0c-1895-4e08-bc05-59f23e7b0545] Reconnected to AMQP server on 10.222.0.79:5672 via [amqp] client with port 41164. Jan 28 02:14:58.087287 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-9b4d205c-983f-490f-8f9b-dca31cd4a2be tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cdbf7d369e4437eae7a36529d6cd623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed8db325d13496c9a417966e33b10a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:14:58.095455 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-9b4d205c-983f-490f-8f9b-dca31cd4a2be tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] 10.222.0.79 "GET /compute/v2.1/servers/678b2127-dbf6-4985-93ba-1171bae26d88" status: 200 len: 1264 microversion: 2.1 time: 0.151953 Jan 28 02:14:58.096059 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 572/1187] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:14:57 2022] GET /compute/v2.1/servers/678b2127-dbf6-4985-93ba-1171bae26d88 => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:14:58.303911 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-e4f22ef6-d315-4843-851b-bea5dfb97853 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:14:58.305286 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-e4f22ef6-d315-4843-851b-bea5dfb97853 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] [instance: 78b24526-46a7-4507-90e0-1273ba252135] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:14:58.313016 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-e4f22ef6-d315-4843-851b-bea5dfb97853 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:58.313410 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-e4f22ef6-d315-4843-851b-bea5dfb97853 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:58.314535 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-e4f22ef6-d315-4843-851b-bea5dfb97853 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:58.315149 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-e4f22ef6-d315-4843-851b-bea5dfb97853 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:58.330009 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.wsgi [None req-e4f22ef6-d315-4843-851b-bea5dfb97853 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] HTTP exception thrown: Instance 78b24526-46a7-4507-90e0-1273ba252135 could not be found. Jan 28 02:14:58.330802 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-e4f22ef6-d315-4843-851b-bea5dfb97853 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] Returning 404 to user: Instance 78b24526-46a7-4507-90e0-1273ba252135 could not be found. {{(pid=116374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 02:14:58.331894 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-e4f22ef6-d315-4843-851b-bea5dfb97853 tempest-VolumesActionsTest-520795863 tempest-VolumesActionsTest-520795863-project] 10.222.0.79 "GET /compute/v2.1/servers/78b24526-46a7-4507-90e0-1273ba252135" status: 404 len: 111 microversion: 2.1 time: 0.034160 Jan 28 02:14:58.332971 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 616/1188] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:14:58 2022] GET /compute/v2.1/servers/78b24526-46a7-4507-90e0-1273ba252135 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 02:14:59.115842 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-058c1c0e-ba77-4b83-a4e6-0ce72746b427 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:14:59.128311 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-058c1c0e-ba77-4b83-a4e6-0ce72746b427 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] [instance: 678b2127-dbf6-4985-93ba-1171bae26d88] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:14:59.135806 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-058c1c0e-ba77-4b83-a4e6-0ce72746b427 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:59.136277 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-058c1c0e-ba77-4b83-a4e6-0ce72746b427 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:59.137262 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-058c1c0e-ba77-4b83-a4e6-0ce72746b427 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:14:59.137906 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-058c1c0e-ba77-4b83-a4e6-0ce72746b427 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:14:59.420943 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-058c1c0e-ba77-4b83-a4e6-0ce72746b427 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cdbf7d369e4437eae7a36529d6cd623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed8db325d13496c9a417966e33b10a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:14:59.429010 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-058c1c0e-ba77-4b83-a4e6-0ce72746b427 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] 10.222.0.79 "GET /compute/v2.1/servers/678b2127-dbf6-4985-93ba-1171bae26d88" status: 200 len: 1264 microversion: 2.1 time: 0.318737 Jan 28 02:14:59.438480 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 573/1189] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:14:59 2022] GET /compute/v2.1/servers/678b2127-dbf6-4985-93ba-1171bae26d88 => generated 1264 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:15:00.445871 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-be53488c-f8c7-4771-a733-370b4d7224c0 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:15:00.446479 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-be53488c-f8c7-4771-a733-370b4d7224c0 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] [instance: 678b2127-dbf6-4985-93ba-1171bae26d88] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:15:00.453092 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-be53488c-f8c7-4771-a733-370b4d7224c0 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:15:00.453092 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-be53488c-f8c7-4771-a733-370b4d7224c0 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:15:00.453806 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-be53488c-f8c7-4771-a733-370b4d7224c0 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:15:00.454229 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-be53488c-f8c7-4771-a733-370b4d7224c0 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:15:00.614789 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-be53488c-f8c7-4771-a733-370b4d7224c0 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cdbf7d369e4437eae7a36529d6cd623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed8db325d13496c9a417966e33b10a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:15:00.622311 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-be53488c-f8c7-4771-a733-370b4d7224c0 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] 10.222.0.79 "GET /compute/v2.1/servers/678b2127-dbf6-4985-93ba-1171bae26d88" status: 200 len: 1264 microversion: 2.1 time: 0.180792 Jan 28 02:15:00.622870 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 617/1190] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:15:00 2022] GET /compute/v2.1/servers/678b2127-dbf6-4985-93ba-1171bae26d88 => generated 1264 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:15:01.640134 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-baf5c2d6-948c-4604-b5dc-a96030c57dfb tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:15:01.640738 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-baf5c2d6-948c-4604-b5dc-a96030c57dfb tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] [instance: 678b2127-dbf6-4985-93ba-1171bae26d88] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:15:01.646523 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-baf5c2d6-948c-4604-b5dc-a96030c57dfb tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:15:01.646968 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-baf5c2d6-948c-4604-b5dc-a96030c57dfb tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:15:01.650179 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-baf5c2d6-948c-4604-b5dc-a96030c57dfb tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:15:01.650179 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-baf5c2d6-948c-4604-b5dc-a96030c57dfb tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:15:01.767063 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-baf5c2d6-948c-4604-b5dc-a96030c57dfb tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cdbf7d369e4437eae7a36529d6cd623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed8db325d13496c9a417966e33b10a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:15:01.774384 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-baf5c2d6-948c-4604-b5dc-a96030c57dfb tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] 10.222.0.79 "GET /compute/v2.1/servers/678b2127-dbf6-4985-93ba-1171bae26d88" status: 200 len: 1264 microversion: 2.1 time: 0.137750 Jan 28 02:15:01.774963 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 574/1191] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:15:01 2022] GET /compute/v2.1/servers/678b2127-dbf6-4985-93ba-1171bae26d88 => generated 1264 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:15:02.241485 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [req-6d9272b5-ea37-448b-950b-29a49ef0db71 req-6f22d826-a7d7-4a74-8695-61ddb72e0e1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "678b2127-dbf6-4985-93ba-1171bae26d88", "name": "network-vif-plugged", "status": "completed", "tag": "41e411b1-116e-434d-a378-dd8425c82364"}]} {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:15:02.243419 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:15:02.243419 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: warnings.warn(msg) Jan 28 02:15:02.252719 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [req-6d9272b5-ea37-448b-950b-29a49ef0db71 req-6f22d826-a7d7-4a74-8695-61ddb72e0e1b service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:15:02.253170 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [req-6d9272b5-ea37-448b-950b-29a49ef0db71 req-6f22d826-a7d7-4a74-8695-61ddb72e0e1b service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:15:02.265044 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.compute.server_external_events [req-6d9272b5-ea37-448b-950b-29a49ef0db71 req-6f22d826-a7d7-4a74-8695-61ddb72e0e1b service nova] Creating event network-vif-plugged:41e411b1-116e-434d-a378-dd8425c82364 for instance 678b2127-dbf6-4985-93ba-1171bae26d88 on hv-cinder-82497 Jan 28 02:15:02.270134 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [req-6d9272b5-ea37-448b-950b-29a49ef0db71 req-6f22d826-a7d7-4a74-8695-61ddb72e0e1b service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033272 Jan 28 02:15:02.270776 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 618/1192] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Jan 28 02:15:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:15:02.791456 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-2092405a-269d-4aa6-af26-c8fb164e0e86 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:15:02.792199 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-2092405a-269d-4aa6-af26-c8fb164e0e86 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] [instance: 678b2127-dbf6-4985-93ba-1171bae26d88] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:15:02.798033 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2092405a-269d-4aa6-af26-c8fb164e0e86 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:15:02.798477 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2092405a-269d-4aa6-af26-c8fb164e0e86 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:15:02.799241 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2092405a-269d-4aa6-af26-c8fb164e0e86 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:15:02.799671 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2092405a-269d-4aa6-af26-c8fb164e0e86 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:15:03.201031 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-2092405a-269d-4aa6-af26-c8fb164e0e86 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cdbf7d369e4437eae7a36529d6cd623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed8db325d13496c9a417966e33b10a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:15:03.208701 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-2092405a-269d-4aa6-af26-c8fb164e0e86 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] 10.222.0.79 "GET /compute/v2.1/servers/678b2127-dbf6-4985-93ba-1171bae26d88" status: 200 len: 1264 microversion: 2.1 time: 0.420843 Jan 28 02:15:03.209284 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 575/1193] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:15:02 2022] GET /compute/v2.1/servers/678b2127-dbf6-4985-93ba-1171bae26d88 => generated 1264 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:15:04.226252 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-f7074ad8-3b90-4647-95a5-5132fd23d17a tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:15:04.226904 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-f7074ad8-3b90-4647-95a5-5132fd23d17a tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] [instance: 678b2127-dbf6-4985-93ba-1171bae26d88] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:15:04.233012 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-f7074ad8-3b90-4647-95a5-5132fd23d17a tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:15:04.233457 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-f7074ad8-3b90-4647-95a5-5132fd23d17a tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:15:04.234219 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-f7074ad8-3b90-4647-95a5-5132fd23d17a tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:15:04.234648 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-f7074ad8-3b90-4647-95a5-5132fd23d17a tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:15:04.357330 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-f7074ad8-3b90-4647-95a5-5132fd23d17a tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cdbf7d369e4437eae7a36529d6cd623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed8db325d13496c9a417966e33b10a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:15:04.364649 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-f7074ad8-3b90-4647-95a5-5132fd23d17a tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] 10.222.0.79 "GET /compute/v2.1/servers/678b2127-dbf6-4985-93ba-1171bae26d88" status: 200 len: 1264 microversion: 2.1 time: 0.142797 Jan 28 02:15:04.365209 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 619/1194] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:15:04 2022] GET /compute/v2.1/servers/678b2127-dbf6-4985-93ba-1171bae26d88 => generated 1264 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:15:05.385372 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-2359758e-b630-4092-b305-1980a2e40b9e tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:15:05.386589 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-2359758e-b630-4092-b305-1980a2e40b9e tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] [instance: 678b2127-dbf6-4985-93ba-1171bae26d88] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:15:05.396970 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2359758e-b630-4092-b305-1980a2e40b9e tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:15:05.398114 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2359758e-b630-4092-b305-1980a2e40b9e tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:15:05.399523 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2359758e-b630-4092-b305-1980a2e40b9e tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:15:05.400268 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-2359758e-b630-4092-b305-1980a2e40b9e tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:15:05.570931 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-2359758e-b630-4092-b305-1980a2e40b9e tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cdbf7d369e4437eae7a36529d6cd623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed8db325d13496c9a417966e33b10a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:15:05.581872 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-2359758e-b630-4092-b305-1980a2e40b9e tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] 10.222.0.79 "GET /compute/v2.1/servers/678b2127-dbf6-4985-93ba-1171bae26d88" status: 200 len: 1450 microversion: 2.1 time: 0.203698 Jan 28 02:15:05.584790 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 576/1195] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:15:05 2022] GET /compute/v2.1/servers/678b2127-dbf6-4985-93ba-1171bae26d88 => generated 1450 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:15:05.603585 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-3a1c9be4-870a-4b91-9898-009a1b42d46e tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:15:05.606035 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-3a1c9be4-870a-4b91-9898-009a1b42d46e tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] [instance: 678b2127-dbf6-4985-93ba-1171bae26d88] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:15:05.611077 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-3a1c9be4-870a-4b91-9898-009a1b42d46e tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:15:05.611513 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-3a1c9be4-870a-4b91-9898-009a1b42d46e tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:15:05.612533 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-3a1c9be4-870a-4b91-9898-009a1b42d46e tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:15:05.613128 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-3a1c9be4-870a-4b91-9898-009a1b42d46e tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:15:05.770145 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-3a1c9be4-870a-4b91-9898-009a1b42d46e tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cdbf7d369e4437eae7a36529d6cd623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed8db325d13496c9a417966e33b10a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:15:05.780400 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-3a1c9be4-870a-4b91-9898-009a1b42d46e tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] 10.222.0.79 "GET /compute/v2.1/servers/678b2127-dbf6-4985-93ba-1171bae26d88" status: 200 len: 1450 microversion: 2.1 time: 0.179614 Jan 28 02:15:05.781018 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 620/1196] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:15:05 2022] GET /compute/v2.1/servers/678b2127-dbf6-4985-93ba-1171bae26d88 => generated 1450 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:15:07.929794 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [req-ad49d030-d2cf-4953-99d5-50e7dd21e0a6 req-e93bc191-679d-40f4-8547-7ad2f31a7c9a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "678b2127-dbf6-4985-93ba-1171bae26d88", "tag": "41e411b1-116e-434d-a378-dd8425c82364"}]} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:15:07.934141 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:15:07.934141 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: warnings.warn(msg) Jan 28 02:15:07.938450 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-ad49d030-d2cf-4953-99d5-50e7dd21e0a6 req-e93bc191-679d-40f4-8547-7ad2f31a7c9a service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:15:07.938889 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-ad49d030-d2cf-4953-99d5-50e7dd21e0a6 req-e93bc191-679d-40f4-8547-7ad2f31a7c9a service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:15:07.951094 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.compute.server_external_events [req-ad49d030-d2cf-4953-99d5-50e7dd21e0a6 req-e93bc191-679d-40f4-8547-7ad2f31a7c9a service nova] Creating event network-changed:41e411b1-116e-434d-a378-dd8425c82364 for instance 678b2127-dbf6-4985-93ba-1171bae26d88 on hv-cinder-82497 Jan 28 02:15:07.956565 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [req-ad49d030-d2cf-4953-99d5-50e7dd21e0a6 req-e93bc191-679d-40f4-8547-7ad2f31a7c9a service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031388 Jan 28 02:15:07.957732 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 577/1197] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Jan 28 02:15:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:15:08.911095 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-c6a4520d-ea95-499a-8226-34f45dd22f7a tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "62f67361-3866-46bb-9903-97a2556b4b54", "device": "/dev/sdb"}} {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:15:08.914727 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-c6a4520d-ea95-499a-8226-34f45dd22f7a tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] [instance: 900f2c3c-cc61-4571-9b4e-d60c85c7daa8] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:15:08.924273 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-c6a4520d-ea95-499a-8226-34f45dd22f7a tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:15:08.925009 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-c6a4520d-ea95-499a-8226-34f45dd22f7a tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:15:08.926542 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-c6a4520d-ea95-499a-8226-34f45dd22f7a tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:15:08.927209 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-c6a4520d-ea95-499a-8226-34f45dd22f7a tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:15:09.852717 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-c6a4520d-ea95-499a-8226-34f45dd22f7a tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] 10.222.0.79 "POST /compute/v2.1/servers/900f2c3c-cc61-4571-9b4e-d60c85c7daa8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.946487 Jan 28 02:15:09.876013 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 621/1198] 10.222.0.79 () {60 vars in 1322 bytes} [Fri Jan 28 02:15:08 2022] POST /compute/v2.1/servers/900f2c3c-cc61-4571-9b4e-d60c85c7daa8/os-volume_attachments => generated 194 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 02:15:35.565370 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-1ca284d8-27d8-44d0-b58e-8244ca38750f tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:15:35.565943 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-1ca284d8-27d8-44d0-b58e-8244ca38750f tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] [instance: 900f2c3c-cc61-4571-9b4e-d60c85c7daa8] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:15:35.572958 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-1ca284d8-27d8-44d0-b58e-8244ca38750f tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:15:35.573406 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-1ca284d8-27d8-44d0-b58e-8244ca38750f tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:15:35.574158 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-1ca284d8-27d8-44d0-b58e-8244ca38750f tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:15:35.574585 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-1ca284d8-27d8-44d0-b58e-8244ca38750f tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:15:35.657478 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.objects.instance [None req-1ca284d8-27d8-44d0-b58e-8244ca38750f tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lazy-loading 'services' on Instance uuid 900f2c3c-cc61-4571-9b4e-d60c85c7daa8 {{(pid=116375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jan 28 02:15:35.904105 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-1ca284d8-27d8-44d0-b58e-8244ca38750f tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] 10.222.0.79 "DELETE /compute/v2.1/servers/900f2c3c-cc61-4571-9b4e-d60c85c7daa8/os-volume_attachments/62f67361-3866-46bb-9903-97a2556b4b54" status: 202 len: 0 microversion: 2.1 time: 0.342586 Jan 28 02:15:35.904664 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 578/1199] 10.222.0.79 () {58 vars in 1415 bytes} [Fri Jan 28 02:15:35 2022] DELETE /compute/v2.1/servers/900f2c3c-cc61-4571-9b4e-d60c85c7daa8/os-volume_attachments/62f67361-3866-46bb-9903-97a2556b4b54 => generated 0 bytes in 344 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:15:38.087806 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-b8e6e8ca-c88a-4b4e-8ca5-aa83203225e2 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:15:38.087806 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-b8e6e8ca-c88a-4b4e-8ca5-aa83203225e2 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] [instance: 900f2c3c-cc61-4571-9b4e-d60c85c7daa8] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:15:38.094869 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-b8e6e8ca-c88a-4b4e-8ca5-aa83203225e2 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:15:38.095312 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-b8e6e8ca-c88a-4b4e-8ca5-aa83203225e2 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:15:38.096120 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-b8e6e8ca-c88a-4b4e-8ca5-aa83203225e2 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:15:38.096554 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-b8e6e8ca-c88a-4b4e-8ca5-aa83203225e2 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:15:38.126149 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-b8e6e8ca-c88a-4b4e-8ca5-aa83203225e2 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] [instance: 900f2c3c-cc61-4571-9b4e-d60c85c7daa8] Going to try to terminate instance {{(pid=116374) delete /opt/stack/nova/nova/compute/api.py:2612}} Jan 28 02:15:38.480959 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-b8e6e8ca-c88a-4b4e-8ca5-aa83203225e2 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] 10.222.0.79 "DELETE /compute/v2.1/servers/900f2c3c-cc61-4571-9b4e-d60c85c7daa8" status: 204 len: 0 microversion: 2.1 time: 0.398912 Jan 28 02:15:38.481543 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 622/1200] 10.222.0.79 () {58 vars in 1238 bytes} [Fri Jan 28 02:15:38 2022] DELETE /compute/v2.1/servers/900f2c3c-cc61-4571-9b4e-d60c85c7daa8 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 28 02:15:38.490655 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-fb616fc7-8ebe-416f-b706-31de1dd7a016 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:15:38.491369 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-fb616fc7-8ebe-416f-b706-31de1dd7a016 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] [instance: 900f2c3c-cc61-4571-9b4e-d60c85c7daa8] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:15:38.497720 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-fb616fc7-8ebe-416f-b706-31de1dd7a016 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:15:38.498165 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-fb616fc7-8ebe-416f-b706-31de1dd7a016 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:15:38.498936 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-fb616fc7-8ebe-416f-b706-31de1dd7a016 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:15:38.499367 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-fb616fc7-8ebe-416f-b706-31de1dd7a016 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:15:38.626914 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-fb616fc7-8ebe-416f-b706-31de1dd7a016 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a44eea6c44247d0a40f007026b1fb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfdaf77bcf5a4358b657de79f178fa6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:15:38.635418 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-fb616fc7-8ebe-416f-b706-31de1dd7a016 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] 10.222.0.79 "GET /compute/v2.1/servers/900f2c3c-cc61-4571-9b4e-d60c85c7daa8" status: 200 len: 1514 microversion: 2.1 time: 0.149298 Jan 28 02:15:38.636033 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 579/1201] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:15:38 2022] GET /compute/v2.1/servers/900f2c3c-cc61-4571-9b4e-d60c85c7daa8 => generated 1514 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:15:39.654761 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-48c3b79a-0fb4-41c0-880f-0d11ee7c2442 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:15:39.655461 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-48c3b79a-0fb4-41c0-880f-0d11ee7c2442 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] [instance: 900f2c3c-cc61-4571-9b4e-d60c85c7daa8] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:15:39.662034 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-48c3b79a-0fb4-41c0-880f-0d11ee7c2442 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:15:39.662484 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-48c3b79a-0fb4-41c0-880f-0d11ee7c2442 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:15:39.663252 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-48c3b79a-0fb4-41c0-880f-0d11ee7c2442 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:15:39.663684 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-48c3b79a-0fb4-41c0-880f-0d11ee7c2442 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:15:39.788321 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-48c3b79a-0fb4-41c0-880f-0d11ee7c2442 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a44eea6c44247d0a40f007026b1fb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfdaf77bcf5a4358b657de79f178fa6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:15:39.795604 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-48c3b79a-0fb4-41c0-880f-0d11ee7c2442 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] 10.222.0.79 "GET /compute/v2.1/servers/900f2c3c-cc61-4571-9b4e-d60c85c7daa8" status: 200 len: 1514 microversion: 2.1 time: 0.144888 Jan 28 02:15:39.796187 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 623/1202] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:15:39 2022] GET /compute/v2.1/servers/900f2c3c-cc61-4571-9b4e-d60c85c7daa8 => generated 1514 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:15:40.813221 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-1fed4802-af63-442d-a315-1d510455d334 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:15:40.813944 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-1fed4802-af63-442d-a315-1d510455d334 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] [instance: 900f2c3c-cc61-4571-9b4e-d60c85c7daa8] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:15:40.819934 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-1fed4802-af63-442d-a315-1d510455d334 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:15:40.820611 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-1fed4802-af63-442d-a315-1d510455d334 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:15:40.821429 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-1fed4802-af63-442d-a315-1d510455d334 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:15:40.821872 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-1fed4802-af63-442d-a315-1d510455d334 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:15:40.976823 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-1fed4802-af63-442d-a315-1d510455d334 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a44eea6c44247d0a40f007026b1fb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfdaf77bcf5a4358b657de79f178fa6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:15:40.983923 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-1fed4802-af63-442d-a315-1d510455d334 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] 10.222.0.79 "GET /compute/v2.1/servers/900f2c3c-cc61-4571-9b4e-d60c85c7daa8" status: 200 len: 1514 microversion: 2.1 time: 0.174531 Jan 28 02:15:40.984511 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 580/1203] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:15:40 2022] GET /compute/v2.1/servers/900f2c3c-cc61-4571-9b4e-d60c85c7daa8 => generated 1514 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:15:41.083273 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [req-5e7f743b-6ac9-46a4-882c-c1a2d8ab4a2b req-49c90a75-2ac9-477e-aa5e-2e5d727a1df6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "900f2c3c-cc61-4571-9b4e-d60c85c7daa8", "name": "network-vif-deleted", "tag": "fc75dee7-62cc-4e1d-b6cb-1fc222e7d59c"}]} {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:15:41.084980 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:15:41.084980 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: warnings.warn(msg) Jan 28 02:15:41.094368 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [req-5e7f743b-6ac9-46a4-882c-c1a2d8ab4a2b req-49c90a75-2ac9-477e-aa5e-2e5d727a1df6 service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:15:41.094368 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [req-5e7f743b-6ac9-46a4-882c-c1a2d8ab4a2b req-49c90a75-2ac9-477e-aa5e-2e5d727a1df6 service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:15:41.104132 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.compute.server_external_events [req-5e7f743b-6ac9-46a4-882c-c1a2d8ab4a2b req-49c90a75-2ac9-477e-aa5e-2e5d727a1df6 service nova] Creating event network-vif-deleted:fc75dee7-62cc-4e1d-b6cb-1fc222e7d59c for instance 900f2c3c-cc61-4571-9b4e-d60c85c7daa8 on hv-cinder-82497 Jan 28 02:15:41.109005 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [req-5e7f743b-6ac9-46a4-882c-c1a2d8ab4a2b req-49c90a75-2ac9-477e-aa5e-2e5d727a1df6 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029657 Jan 28 02:15:41.109663 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 624/1204] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Jan 28 02:15:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 02:15:42.002188 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-9200a225-3be1-4ec1-bfda-cd07a36549db tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:15:42.002781 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-9200a225-3be1-4ec1-bfda-cd07a36549db tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] [instance: 900f2c3c-cc61-4571-9b4e-d60c85c7daa8] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:15:42.008690 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-9200a225-3be1-4ec1-bfda-cd07a36549db tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:15:42.009129 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-9200a225-3be1-4ec1-bfda-cd07a36549db tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:15:42.009881 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-9200a225-3be1-4ec1-bfda-cd07a36549db tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:15:42.010381 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-9200a225-3be1-4ec1-bfda-cd07a36549db tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:15:42.042238 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-9200a225-3be1-4ec1-bfda-cd07a36549db tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:15:42.042604 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-9200a225-3be1-4ec1-bfda-cd07a36549db tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:15:42.043052 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.objects.instance [None req-9200a225-3be1-4ec1-bfda-cd07a36549db tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lazy-loading 'fault' on Instance uuid 900f2c3c-cc61-4571-9b4e-d60c85c7daa8 {{(pid=116375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jan 28 02:15:42.084402 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-9200a225-3be1-4ec1-bfda-cd07a36549db tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a44eea6c44247d0a40f007026b1fb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfdaf77bcf5a4358b657de79f178fa6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:15:42.091699 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-9200a225-3be1-4ec1-bfda-cd07a36549db tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] 10.222.0.79 "GET /compute/v2.1/servers/900f2c3c-cc61-4571-9b4e-d60c85c7daa8" status: 200 len: 1309 microversion: 2.1 time: 0.093196 Jan 28 02:15:42.092291 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 581/1205] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:15:41 2022] GET /compute/v2.1/servers/900f2c3c-cc61-4571-9b4e-d60c85c7daa8 => generated 1309 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:15:43.110931 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-654b49a7-9ce9-461a-8711-debf117a5020 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:15:43.111612 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-654b49a7-9ce9-461a-8711-debf117a5020 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] [instance: 900f2c3c-cc61-4571-9b4e-d60c85c7daa8] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:15:43.118947 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-654b49a7-9ce9-461a-8711-debf117a5020 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:15:43.119391 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-654b49a7-9ce9-461a-8711-debf117a5020 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:15:43.120768 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-654b49a7-9ce9-461a-8711-debf117a5020 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:15:43.120768 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-654b49a7-9ce9-461a-8711-debf117a5020 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:15:43.136193 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.wsgi [None req-654b49a7-9ce9-461a-8711-debf117a5020 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] HTTP exception thrown: Instance 900f2c3c-cc61-4571-9b4e-d60c85c7daa8 could not be found. Jan 28 02:15:43.136808 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-654b49a7-9ce9-461a-8711-debf117a5020 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Returning 404 to user: Instance 900f2c3c-cc61-4571-9b4e-d60c85c7daa8 could not be found. {{(pid=116374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 02:15:43.137630 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-654b49a7-9ce9-461a-8711-debf117a5020 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] 10.222.0.79 "GET /compute/v2.1/servers/900f2c3c-cc61-4571-9b4e-d60c85c7daa8" status: 404 len: 111 microversion: 2.1 time: 0.030885 Jan 28 02:15:43.138579 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 625/1206] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:15:43 2022] GET /compute/v2.1/servers/900f2c3c-cc61-4571-9b4e-d60c85c7daa8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 02:15:53.583935 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-7fefb6fa-67c1-4206-8b7b-55cbf53856ee tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1393876538", "imageRef": "04805ce8-b0a0-41b2-b614-bfb5b752cc5d", "flavorRef": "452", "networks": [{"uuid": "c1617250-6906-428a-b42f-41a62d6e9eab"}]}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:15:53.636011 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.network.neutron [None req-7fefb6fa-67c1-4206-8b7b-55cbf53856ee tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] validate_networks() for [('c1617250-6906-428a-b42f-41a62d6e9eab', None, None, None, None, None)] {{(pid=116375) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Jan 28 02:15:53.973864 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.virt.hardware [None req-7fefb6fa-67c1-4206-8b7b-55cbf53856ee tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Flavor limits 0:0:0 {{(pid=116375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 02:15:53.974277 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.virt.hardware [None req-7fefb6fa-67c1-4206-8b7b-55cbf53856ee tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Image limits 0:0:0 {{(pid=116375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 02:15:53.974734 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.virt.hardware [None req-7fefb6fa-67c1-4206-8b7b-55cbf53856ee tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Flavor pref 0:0:0 {{(pid=116375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 02:15:53.975129 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.virt.hardware [None req-7fefb6fa-67c1-4206-8b7b-55cbf53856ee tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Image pref 0:0:0 {{(pid=116375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 02:15:53.975525 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.virt.hardware [None req-7fefb6fa-67c1-4206-8b7b-55cbf53856ee tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116375) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 02:15:53.984871 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-7fefb6fa-67c1-4206-8b7b-55cbf53856ee tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:15:53.985308 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-7fefb6fa-67c1-4206-8b7b-55cbf53856ee tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:15:53.986087 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-7fefb6fa-67c1-4206-8b7b-55cbf53856ee tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:15:53.986514 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-7fefb6fa-67c1-4206-8b7b-55cbf53856ee tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:15:54.003458 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.quota [None req-7fefb6fa-67c1-4206-8b7b-55cbf53856ee tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Getting quotas for project dfdaf77bcf5a4358b657de79f178fa6e. Resources: {'ram', 'cores', 'instances'} {{(pid=116375) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 02:15:54.007653 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.quota [None req-7fefb6fa-67c1-4206-8b7b-55cbf53856ee tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Getting quotas for user 6a44eea6c44247d0a40f007026b1fb93 and project dfdaf77bcf5a4358b657de79f178fa6e. Resources: {'ram', 'cores', 'instances'} {{(pid=116375) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 02:15:54.018294 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-7fefb6fa-67c1-4206-8b7b-55cbf53856ee tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Going to run 1 instances... {{(pid=116375) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 02:15:54.021971 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-7fefb6fa-67c1-4206-8b7b-55cbf53856ee tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] [instance: 801d8c8a-8534-43b5-a61f-347cbf9418b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='04805ce8-b0a0-41b2-b614-bfb5b752cc5d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116375) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 02:15:54.220161 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-7fefb6fa-67c1-4206-8b7b-55cbf53856ee tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.639940 Jan 28 02:15:54.220991 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 582/1207] 10.222.0.79 () {60 vars in 1146 bytes} [Fri Jan 28 02:15:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 642 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 28 02:15:54.231588 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-36891cbf-57db-4617-9f87-0b7af4dcc673 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:15:54.232706 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-36891cbf-57db-4617-9f87-0b7af4dcc673 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] [instance: 801d8c8a-8534-43b5-a61f-347cbf9418b5] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:15:54.290083 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-36891cbf-57db-4617-9f87-0b7af4dcc673 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a44eea6c44247d0a40f007026b1fb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfdaf77bcf5a4358b657de79f178fa6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:15:54.296649 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-36891cbf-57db-4617-9f87-0b7af4dcc673 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] 10.222.0.79 "GET /compute/v2.1/servers/801d8c8a-8534-43b5-a61f-347cbf9418b5" status: 200 len: 1219 microversion: 2.1 time: 0.068660 Jan 28 02:15:54.297151 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 626/1208] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:15:54 2022] GET /compute/v2.1/servers/801d8c8a-8534-43b5-a61f-347cbf9418b5 => generated 1219 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:15:55.313534 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-1c7a84dc-090f-4e17-a82e-2d8183a804fd tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:15:55.314249 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-1c7a84dc-090f-4e17-a82e-2d8183a804fd tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] [instance: 801d8c8a-8534-43b5-a61f-347cbf9418b5] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:15:55.320940 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-1c7a84dc-090f-4e17-a82e-2d8183a804fd tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:15:55.321377 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-1c7a84dc-090f-4e17-a82e-2d8183a804fd tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:15:55.322135 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-1c7a84dc-090f-4e17-a82e-2d8183a804fd tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:15:55.322557 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-1c7a84dc-090f-4e17-a82e-2d8183a804fd tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:15:55.380575 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-1c7a84dc-090f-4e17-a82e-2d8183a804fd tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a44eea6c44247d0a40f007026b1fb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfdaf77bcf5a4358b657de79f178fa6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:15:55.387744 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-1c7a84dc-090f-4e17-a82e-2d8183a804fd tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] 10.222.0.79 "GET /compute/v2.1/servers/801d8c8a-8534-43b5-a61f-347cbf9418b5" status: 200 len: 1223 microversion: 2.1 time: 0.077924 Jan 28 02:15:55.388354 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 583/1209] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:15:55 2022] GET /compute/v2.1/servers/801d8c8a-8534-43b5-a61f-347cbf9418b5 => generated 1223 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:15:56.403568 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-e949befe-ab9d-44e7-9018-bd66e2e636ec tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:15:56.404296 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-e949befe-ab9d-44e7-9018-bd66e2e636ec tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] [instance: 801d8c8a-8534-43b5-a61f-347cbf9418b5] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:15:56.410800 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-e949befe-ab9d-44e7-9018-bd66e2e636ec tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:15:56.411245 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-e949befe-ab9d-44e7-9018-bd66e2e636ec tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:15:56.412033 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-e949befe-ab9d-44e7-9018-bd66e2e636ec tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:15:56.412463 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-e949befe-ab9d-44e7-9018-bd66e2e636ec tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:15:56.483504 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-e949befe-ab9d-44e7-9018-bd66e2e636ec tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a44eea6c44247d0a40f007026b1fb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfdaf77bcf5a4358b657de79f178fa6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:15:56.492229 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-e949befe-ab9d-44e7-9018-bd66e2e636ec tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] 10.222.0.79 "GET /compute/v2.1/servers/801d8c8a-8534-43b5-a61f-347cbf9418b5" status: 200 len: 1279 microversion: 2.1 time: 0.092112 Jan 28 02:15:56.501445 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 627/1210] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:15:56 2022] GET /compute/v2.1/servers/801d8c8a-8534-43b5-a61f-347cbf9418b5 => generated 1279 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:15:57.509807 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-6895255c-ea43-40f5-8398-91feaef7d6b8 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:15:57.510415 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-6895255c-ea43-40f5-8398-91feaef7d6b8 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] [instance: 801d8c8a-8534-43b5-a61f-347cbf9418b5] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:15:57.516506 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-6895255c-ea43-40f5-8398-91feaef7d6b8 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:15:57.516947 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-6895255c-ea43-40f5-8398-91feaef7d6b8 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:15:57.517821 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-6895255c-ea43-40f5-8398-91feaef7d6b8 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:15:57.518245 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-6895255c-ea43-40f5-8398-91feaef7d6b8 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:15:57.787918 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-6895255c-ea43-40f5-8398-91feaef7d6b8 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a44eea6c44247d0a40f007026b1fb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfdaf77bcf5a4358b657de79f178fa6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:15:57.795250 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-6895255c-ea43-40f5-8398-91feaef7d6b8 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] 10.222.0.79 "GET /compute/v2.1/servers/801d8c8a-8534-43b5-a61f-347cbf9418b5" status: 200 len: 1319 microversion: 2.1 time: 0.289129 Jan 28 02:15:57.795820 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 584/1211] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:15:57 2022] GET /compute/v2.1/servers/801d8c8a-8534-43b5-a61f-347cbf9418b5 => generated 1319 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:15:58.463203 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [req-1a650d3e-ae24-4e27-b3ec-b49697788a5e req-0c07eb9d-0e29-4845-9c66-e7b68d836ce6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "801d8c8a-8534-43b5-a61f-347cbf9418b5", "tag": "5941e59f-f75d-4783-a1fd-1c27270e7e7c"}]} {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:15:58.464842 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:15:58.464842 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: warnings.warn(msg) Jan 28 02:15:58.471720 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [req-1a650d3e-ae24-4e27-b3ec-b49697788a5e req-0c07eb9d-0e29-4845-9c66-e7b68d836ce6 service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:15:58.472289 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [req-1a650d3e-ae24-4e27-b3ec-b49697788a5e req-0c07eb9d-0e29-4845-9c66-e7b68d836ce6 service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:15:58.484751 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.compute.server_external_events [req-1a650d3e-ae24-4e27-b3ec-b49697788a5e req-0c07eb9d-0e29-4845-9c66-e7b68d836ce6 service nova] Creating event network-changed:5941e59f-f75d-4783-a1fd-1c27270e7e7c for instance 801d8c8a-8534-43b5-a61f-347cbf9418b5 on hv-cinder-82497 Jan 28 02:15:58.490550 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [req-1a650d3e-ae24-4e27-b3ec-b49697788a5e req-0c07eb9d-0e29-4845-9c66-e7b68d836ce6 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031291 Jan 28 02:15:58.491416 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 628/1212] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Jan 28 02:15:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:15:58.813340 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-a845e367-4eb2-403b-ab83-42be66bae2d3 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:15:58.813968 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-a845e367-4eb2-403b-ab83-42be66bae2d3 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] [instance: 801d8c8a-8534-43b5-a61f-347cbf9418b5] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:15:58.820855 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a845e367-4eb2-403b-ab83-42be66bae2d3 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:15:58.821295 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a845e367-4eb2-403b-ab83-42be66bae2d3 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:15:58.822064 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a845e367-4eb2-403b-ab83-42be66bae2d3 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:15:58.823169 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a845e367-4eb2-403b-ab83-42be66bae2d3 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:15:58.987670 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-a845e367-4eb2-403b-ab83-42be66bae2d3 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a44eea6c44247d0a40f007026b1fb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfdaf77bcf5a4358b657de79f178fa6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:15:58.997468 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-a845e367-4eb2-403b-ab83-42be66bae2d3 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] 10.222.0.79 "GET /compute/v2.1/servers/801d8c8a-8534-43b5-a61f-347cbf9418b5" status: 200 len: 1319 microversion: 2.1 time: 0.188031 Jan 28 02:15:58.998059 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 585/1213] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:15:58 2022] GET /compute/v2.1/servers/801d8c8a-8534-43b5-a61f-347cbf9418b5 => generated 1319 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:16:00.017587 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-fd0232f0-9eae-4d83-83d9-2e5391bc624d tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:16:00.018290 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-fd0232f0-9eae-4d83-83d9-2e5391bc624d tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] [instance: 801d8c8a-8534-43b5-a61f-347cbf9418b5] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:16:00.025079 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-fd0232f0-9eae-4d83-83d9-2e5391bc624d tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:16:00.025522 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-fd0232f0-9eae-4d83-83d9-2e5391bc624d tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:16:00.026342 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-fd0232f0-9eae-4d83-83d9-2e5391bc624d tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:16:00.026729 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-fd0232f0-9eae-4d83-83d9-2e5391bc624d tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:16:00.162402 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-fd0232f0-9eae-4d83-83d9-2e5391bc624d tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a44eea6c44247d0a40f007026b1fb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfdaf77bcf5a4358b657de79f178fa6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:16:00.169800 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-fd0232f0-9eae-4d83-83d9-2e5391bc624d tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] 10.222.0.79 "GET /compute/v2.1/servers/801d8c8a-8534-43b5-a61f-347cbf9418b5" status: 200 len: 1319 microversion: 2.1 time: 0.156327 Jan 28 02:16:00.170360 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 629/1214] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:16:00 2022] GET /compute/v2.1/servers/801d8c8a-8534-43b5-a61f-347cbf9418b5 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:16:01.190653 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-3dfc5228-bf45-433f-84cc-442c3359e4e5 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:16:01.192310 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-3dfc5228-bf45-433f-84cc-442c3359e4e5 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] [instance: 801d8c8a-8534-43b5-a61f-347cbf9418b5] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:16:01.198272 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-3dfc5228-bf45-433f-84cc-442c3359e4e5 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:16:01.198711 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-3dfc5228-bf45-433f-84cc-442c3359e4e5 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:16:01.199470 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-3dfc5228-bf45-433f-84cc-442c3359e4e5 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:16:01.199890 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-3dfc5228-bf45-433f-84cc-442c3359e4e5 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:16:01.511437 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-3dfc5228-bf45-433f-84cc-442c3359e4e5 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a44eea6c44247d0a40f007026b1fb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfdaf77bcf5a4358b657de79f178fa6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:16:01.519184 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-3dfc5228-bf45-433f-84cc-442c3359e4e5 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] 10.222.0.79 "GET /compute/v2.1/servers/801d8c8a-8534-43b5-a61f-347cbf9418b5" status: 200 len: 1319 microversion: 2.1 time: 0.334923 Jan 28 02:16:01.519918 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 586/1215] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:16:01 2022] GET /compute/v2.1/servers/801d8c8a-8534-43b5-a61f-347cbf9418b5 => generated 1319 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:16:02.537990 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-2279a679-95dc-40e4-b125-7ef02bfb3a67 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:16:02.538583 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-2279a679-95dc-40e4-b125-7ef02bfb3a67 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] [instance: 801d8c8a-8534-43b5-a61f-347cbf9418b5] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:16:02.544426 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-2279a679-95dc-40e4-b125-7ef02bfb3a67 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:16:02.544865 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-2279a679-95dc-40e4-b125-7ef02bfb3a67 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:16:02.545624 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-2279a679-95dc-40e4-b125-7ef02bfb3a67 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:16:02.546052 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-2279a679-95dc-40e4-b125-7ef02bfb3a67 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:16:02.721504 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-2279a679-95dc-40e4-b125-7ef02bfb3a67 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a44eea6c44247d0a40f007026b1fb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfdaf77bcf5a4358b657de79f178fa6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:16:02.729585 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-2279a679-95dc-40e4-b125-7ef02bfb3a67 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] 10.222.0.79 "GET /compute/v2.1/servers/801d8c8a-8534-43b5-a61f-347cbf9418b5" status: 200 len: 1319 microversion: 2.1 time: 0.195853 Jan 28 02:16:02.730145 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 630/1216] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:16:02 2022] GET /compute/v2.1/servers/801d8c8a-8534-43b5-a61f-347cbf9418b5 => generated 1319 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:16:03.477017 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [req-754d414a-53df-485c-b378-28ecfab01677 req-05584a0d-289d-4559-913c-4f49cc2415b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "801d8c8a-8534-43b5-a61f-347cbf9418b5", "name": "network-vif-plugged", "status": "completed", "tag": "5941e59f-f75d-4783-a1fd-1c27270e7e7c"}]} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:16:03.478542 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:16:03.478542 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: warnings.warn(msg) Jan 28 02:16:03.485343 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-754d414a-53df-485c-b378-28ecfab01677 req-05584a0d-289d-4559-913c-4f49cc2415b1 service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:16:03.485778 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-754d414a-53df-485c-b378-28ecfab01677 req-05584a0d-289d-4559-913c-4f49cc2415b1 service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:16:03.497441 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.compute.server_external_events [req-754d414a-53df-485c-b378-28ecfab01677 req-05584a0d-289d-4559-913c-4f49cc2415b1 service nova] Creating event network-vif-plugged:5941e59f-f75d-4783-a1fd-1c27270e7e7c for instance 801d8c8a-8534-43b5-a61f-347cbf9418b5 on hv-cinder-82497 Jan 28 02:16:03.502459 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [req-754d414a-53df-485c-b378-28ecfab01677 req-05584a0d-289d-4559-913c-4f49cc2415b1 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029928 Jan 28 02:16:03.506106 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 587/1217] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Jan 28 02:16:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:16:03.746309 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-d649f979-5819-4aaf-acaf-de3f3e9993f5 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:16:03.746916 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-d649f979-5819-4aaf-acaf-de3f3e9993f5 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] [instance: 801d8c8a-8534-43b5-a61f-347cbf9418b5] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:16:03.752742 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-d649f979-5819-4aaf-acaf-de3f3e9993f5 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:16:03.753180 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-d649f979-5819-4aaf-acaf-de3f3e9993f5 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:16:03.754011 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-d649f979-5819-4aaf-acaf-de3f3e9993f5 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:16:03.754476 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-d649f979-5819-4aaf-acaf-de3f3e9993f5 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:16:03.908522 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-d649f979-5819-4aaf-acaf-de3f3e9993f5 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a44eea6c44247d0a40f007026b1fb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfdaf77bcf5a4358b657de79f178fa6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:16:03.916270 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-d649f979-5819-4aaf-acaf-de3f3e9993f5 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] 10.222.0.79 "GET /compute/v2.1/servers/801d8c8a-8534-43b5-a61f-347cbf9418b5" status: 200 len: 1319 microversion: 2.1 time: 0.173443 Jan 28 02:16:03.916765 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 631/1218] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:16:03 2022] GET /compute/v2.1/servers/801d8c8a-8534-43b5-a61f-347cbf9418b5 => generated 1319 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:16:04.936853 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-f85ee6e7-918f-4f03-8f06-f5d3a1848514 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:16:04.937528 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-f85ee6e7-918f-4f03-8f06-f5d3a1848514 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] [instance: 801d8c8a-8534-43b5-a61f-347cbf9418b5] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:16:04.944279 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f85ee6e7-918f-4f03-8f06-f5d3a1848514 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:16:04.944719 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f85ee6e7-918f-4f03-8f06-f5d3a1848514 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:16:04.945476 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f85ee6e7-918f-4f03-8f06-f5d3a1848514 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:16:04.945904 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f85ee6e7-918f-4f03-8f06-f5d3a1848514 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:16:05.070368 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-f85ee6e7-918f-4f03-8f06-f5d3a1848514 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a44eea6c44247d0a40f007026b1fb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfdaf77bcf5a4358b657de79f178fa6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:16:05.078057 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-f85ee6e7-918f-4f03-8f06-f5d3a1848514 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] 10.222.0.79 "GET /compute/v2.1/servers/801d8c8a-8534-43b5-a61f-347cbf9418b5" status: 200 len: 1319 microversion: 2.1 time: 0.145261 Jan 28 02:16:05.083355 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 588/1219] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:16:04 2022] GET /compute/v2.1/servers/801d8c8a-8534-43b5-a61f-347cbf9418b5 => generated 1319 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:16:06.094699 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-abe5ba67-429c-46dd-83ff-0499b90a333c tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:16:06.095338 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-abe5ba67-429c-46dd-83ff-0499b90a333c tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] [instance: 801d8c8a-8534-43b5-a61f-347cbf9418b5] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:16:06.101811 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-abe5ba67-429c-46dd-83ff-0499b90a333c tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:16:06.102256 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-abe5ba67-429c-46dd-83ff-0499b90a333c tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:16:06.103023 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-abe5ba67-429c-46dd-83ff-0499b90a333c tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:16:06.103453 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-abe5ba67-429c-46dd-83ff-0499b90a333c tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:16:06.226251 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-abe5ba67-429c-46dd-83ff-0499b90a333c tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a44eea6c44247d0a40f007026b1fb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfdaf77bcf5a4358b657de79f178fa6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:16:06.233637 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-abe5ba67-429c-46dd-83ff-0499b90a333c tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] 10.222.0.79 "GET /compute/v2.1/servers/801d8c8a-8534-43b5-a61f-347cbf9418b5" status: 200 len: 1509 microversion: 2.1 time: 0.142602 Jan 28 02:16:06.242669 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 632/1220] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:16:06 2022] GET /compute/v2.1/servers/801d8c8a-8534-43b5-a61f-347cbf9418b5 => generated 1509 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:16:06.250292 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-c0e5951c-92a8-4708-a79f-4f4d817ee4c2 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7f13cede-88d7-4674-a7b7-b838e0eea8e3", "device": "/dev/sdb"}} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:16:06.251824 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-c0e5951c-92a8-4708-a79f-4f4d817ee4c2 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] [instance: 801d8c8a-8534-43b5-a61f-347cbf9418b5] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:16:06.259114 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c0e5951c-92a8-4708-a79f-4f4d817ee4c2 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:16:06.259581 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c0e5951c-92a8-4708-a79f-4f4d817ee4c2 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:16:06.260507 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c0e5951c-92a8-4708-a79f-4f4d817ee4c2 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:16:06.260935 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-c0e5951c-92a8-4708-a79f-4f4d817ee4c2 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:16:07.061658 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-c0e5951c-92a8-4708-a79f-4f4d817ee4c2 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] 10.222.0.79 "POST /compute/v2.1/servers/801d8c8a-8534-43b5-a61f-347cbf9418b5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.814874 Jan 28 02:16:07.062281 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 589/1221] 10.222.0.79 () {60 vars in 1322 bytes} [Fri Jan 28 02:16:06 2022] POST /compute/v2.1/servers/801d8c8a-8534-43b5-a61f-347cbf9418b5/os-volume_attachments => generated 194 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:16:17.359894 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 28 02:16:17.360606 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: Fri Jan 28 02:16:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 28 02:16:27.971998 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-fdd8aa3f-0e5d-4295-933a-13103f93c80c tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:16:27.972559 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-fdd8aa3f-0e5d-4295-933a-13103f93c80c tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] [instance: 801d8c8a-8534-43b5-a61f-347cbf9418b5] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:16:27.979234 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-fdd8aa3f-0e5d-4295-933a-13103f93c80c tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:16:27.979680 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-fdd8aa3f-0e5d-4295-933a-13103f93c80c tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:16:27.980531 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-fdd8aa3f-0e5d-4295-933a-13103f93c80c tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:16:27.980965 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-fdd8aa3f-0e5d-4295-933a-13103f93c80c tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:16:28.071617 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.objects.instance [None req-fdd8aa3f-0e5d-4295-933a-13103f93c80c tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lazy-loading 'services' on Instance uuid 801d8c8a-8534-43b5-a61f-347cbf9418b5 {{(pid=116374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jan 28 02:16:28.268076 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-fdd8aa3f-0e5d-4295-933a-13103f93c80c tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] 10.222.0.79 "DELETE /compute/v2.1/servers/801d8c8a-8534-43b5-a61f-347cbf9418b5/os-volume_attachments/7f13cede-88d7-4674-a7b7-b838e0eea8e3" status: 202 len: 0 microversion: 2.1 time: 0.299679 Jan 28 02:16:28.268620 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 633/1222] 10.222.0.79 () {58 vars in 1415 bytes} [Fri Jan 28 02:16:27 2022] DELETE /compute/v2.1/servers/801d8c8a-8534-43b5-a61f-347cbf9418b5/os-volume_attachments/7f13cede-88d7-4674-a7b7-b838e0eea8e3 => generated 0 bytes in 301 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:16:30.443614 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-61054810-a2b4-434c-98c5-14d61a2cfa64 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:16:30.444220 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-61054810-a2b4-434c-98c5-14d61a2cfa64 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] [instance: 801d8c8a-8534-43b5-a61f-347cbf9418b5] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:16:30.451580 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-61054810-a2b4-434c-98c5-14d61a2cfa64 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:16:30.452129 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-61054810-a2b4-434c-98c5-14d61a2cfa64 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:16:30.452891 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-61054810-a2b4-434c-98c5-14d61a2cfa64 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:16:30.453317 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-61054810-a2b4-434c-98c5-14d61a2cfa64 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:16:30.478463 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-61054810-a2b4-434c-98c5-14d61a2cfa64 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] [instance: 801d8c8a-8534-43b5-a61f-347cbf9418b5] Going to try to terminate instance {{(pid=116375) delete /opt/stack/nova/nova/compute/api.py:2612}} Jan 28 02:16:30.811153 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-61054810-a2b4-434c-98c5-14d61a2cfa64 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] 10.222.0.79 "DELETE /compute/v2.1/servers/801d8c8a-8534-43b5-a61f-347cbf9418b5" status: 204 len: 0 microversion: 2.1 time: 0.371920 Jan 28 02:16:30.811655 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 590/1223] 10.222.0.79 () {58 vars in 1238 bytes} [Fri Jan 28 02:16:30 2022] DELETE /compute/v2.1/servers/801d8c8a-8534-43b5-a61f-347cbf9418b5 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 28 02:16:30.826600 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-308799ee-49f6-4c20-b3d9-d090c6f58464 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:16:30.827277 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-308799ee-49f6-4c20-b3d9-d090c6f58464 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] [instance: 801d8c8a-8534-43b5-a61f-347cbf9418b5] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:16:30.833536 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-308799ee-49f6-4c20-b3d9-d090c6f58464 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:16:30.833978 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-308799ee-49f6-4c20-b3d9-d090c6f58464 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:16:30.834736 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-308799ee-49f6-4c20-b3d9-d090c6f58464 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:16:30.835159 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-308799ee-49f6-4c20-b3d9-d090c6f58464 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:16:30.961019 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-308799ee-49f6-4c20-b3d9-d090c6f58464 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a44eea6c44247d0a40f007026b1fb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfdaf77bcf5a4358b657de79f178fa6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:16:30.968386 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-308799ee-49f6-4c20-b3d9-d090c6f58464 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] 10.222.0.79 "GET /compute/v2.1/servers/801d8c8a-8534-43b5-a61f-347cbf9418b5" status: 200 len: 1515 microversion: 2.1 time: 0.145875 Jan 28 02:16:30.968944 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 634/1224] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:16:30 2022] GET /compute/v2.1/servers/801d8c8a-8534-43b5-a61f-347cbf9418b5 => generated 1515 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:16:31.986987 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-5483a7c8-171f-45b5-8af7-33d57519dbbd tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:16:31.988076 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-5483a7c8-171f-45b5-8af7-33d57519dbbd tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] [instance: 801d8c8a-8534-43b5-a61f-347cbf9418b5] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:16:31.994039 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-5483a7c8-171f-45b5-8af7-33d57519dbbd tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:16:31.994485 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-5483a7c8-171f-45b5-8af7-33d57519dbbd tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:16:31.995252 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-5483a7c8-171f-45b5-8af7-33d57519dbbd tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:16:31.995681 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-5483a7c8-171f-45b5-8af7-33d57519dbbd tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:16:32.122941 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-5483a7c8-171f-45b5-8af7-33d57519dbbd tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a44eea6c44247d0a40f007026b1fb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfdaf77bcf5a4358b657de79f178fa6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:16:32.130599 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-5483a7c8-171f-45b5-8af7-33d57519dbbd tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] 10.222.0.79 "GET /compute/v2.1/servers/801d8c8a-8534-43b5-a61f-347cbf9418b5" status: 200 len: 1515 microversion: 2.1 time: 0.147751 Jan 28 02:16:32.131167 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 591/1225] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:16:31 2022] GET /compute/v2.1/servers/801d8c8a-8534-43b5-a61f-347cbf9418b5 => generated 1515 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:16:33.148473 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-20d7db06-d484-4f0f-af05-9e4b78cb7f78 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:16:33.149208 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-20d7db06-d484-4f0f-af05-9e4b78cb7f78 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] [instance: 801d8c8a-8534-43b5-a61f-347cbf9418b5] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:16:33.155275 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-20d7db06-d484-4f0f-af05-9e4b78cb7f78 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:16:33.155775 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-20d7db06-d484-4f0f-af05-9e4b78cb7f78 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:16:33.156568 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-20d7db06-d484-4f0f-af05-9e4b78cb7f78 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:16:33.156997 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-20d7db06-d484-4f0f-af05-9e4b78cb7f78 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:16:33.326200 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-20d7db06-d484-4f0f-af05-9e4b78cb7f78 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a44eea6c44247d0a40f007026b1fb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfdaf77bcf5a4358b657de79f178fa6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:16:33.333470 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-20d7db06-d484-4f0f-af05-9e4b78cb7f78 tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] 10.222.0.79 "GET /compute/v2.1/servers/801d8c8a-8534-43b5-a61f-347cbf9418b5" status: 200 len: 1515 microversion: 2.1 time: 0.188917 Jan 28 02:16:33.334027 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 635/1226] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:16:33 2022] GET /compute/v2.1/servers/801d8c8a-8534-43b5-a61f-347cbf9418b5 => generated 1515 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:16:33.584004 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [req-f630de1c-b55c-4b19-b410-375424c4624a req-5620eca5-2859-418e-b940-6e9a8955a321 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "801d8c8a-8534-43b5-a61f-347cbf9418b5", "name": "network-vif-deleted", "tag": "5941e59f-f75d-4783-a1fd-1c27270e7e7c"}]} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:16:33.588667 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:16:33.588667 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: warnings.warn(msg) Jan 28 02:16:33.592863 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-f630de1c-b55c-4b19-b410-375424c4624a req-5620eca5-2859-418e-b940-6e9a8955a321 service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:16:33.593307 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-f630de1c-b55c-4b19-b410-375424c4624a req-5620eca5-2859-418e-b940-6e9a8955a321 service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:16:33.606649 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.compute.server_external_events [req-f630de1c-b55c-4b19-b410-375424c4624a req-5620eca5-2859-418e-b940-6e9a8955a321 service nova] Creating event network-vif-deleted:5941e59f-f75d-4783-a1fd-1c27270e7e7c for instance 801d8c8a-8534-43b5-a61f-347cbf9418b5 on hv-cinder-82497 Jan 28 02:16:33.613256 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [req-f630de1c-b55c-4b19-b410-375424c4624a req-5620eca5-2859-418e-b940-6e9a8955a321 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097545 Jan 28 02:16:33.613860 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 592/1227] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Jan 28 02:16:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:16:34.351891 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-9a5abd19-53c2-48d4-9923-de3086bd869f tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:16:34.352608 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-9a5abd19-53c2-48d4-9923-de3086bd869f tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] [instance: 801d8c8a-8534-43b5-a61f-347cbf9418b5] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:16:34.358435 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-9a5abd19-53c2-48d4-9923-de3086bd869f tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:16:34.358905 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-9a5abd19-53c2-48d4-9923-de3086bd869f tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:16:34.359654 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-9a5abd19-53c2-48d4-9923-de3086bd869f tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:16:34.360108 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-9a5abd19-53c2-48d4-9923-de3086bd869f tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:16:34.390575 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-9a5abd19-53c2-48d4-9923-de3086bd869f tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:16:34.391012 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-9a5abd19-53c2-48d4-9923-de3086bd869f tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:16:34.391725 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.objects.instance [None req-9a5abd19-53c2-48d4-9923-de3086bd869f tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lazy-loading 'fault' on Instance uuid 801d8c8a-8534-43b5-a61f-347cbf9418b5 {{(pid=116374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jan 28 02:16:34.431548 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-9a5abd19-53c2-48d4-9923-de3086bd869f tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a44eea6c44247d0a40f007026b1fb93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfdaf77bcf5a4358b657de79f178fa6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:16:34.438926 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-9a5abd19-53c2-48d4-9923-de3086bd869f tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] 10.222.0.79 "GET /compute/v2.1/servers/801d8c8a-8534-43b5-a61f-347cbf9418b5" status: 200 len: 1309 microversion: 2.1 time: 0.091038 Jan 28 02:16:34.439492 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 636/1228] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:16:34 2022] GET /compute/v2.1/servers/801d8c8a-8534-43b5-a61f-347cbf9418b5 => generated 1309 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:16:35.455879 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-092d804e-1175-4732-a495-6e258a5d75ca tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:16:35.456655 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-092d804e-1175-4732-a495-6e258a5d75ca tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] [instance: 801d8c8a-8534-43b5-a61f-347cbf9418b5] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:16:35.462713 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-092d804e-1175-4732-a495-6e258a5d75ca tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:16:35.463150 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-092d804e-1175-4732-a495-6e258a5d75ca tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:16:35.463896 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-092d804e-1175-4732-a495-6e258a5d75ca tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:16:35.464368 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-092d804e-1175-4732-a495-6e258a5d75ca tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:16:35.477553 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.wsgi [None req-092d804e-1175-4732-a495-6e258a5d75ca tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] HTTP exception thrown: Instance 801d8c8a-8534-43b5-a61f-347cbf9418b5 could not be found. Jan 28 02:16:35.478156 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-092d804e-1175-4732-a495-6e258a5d75ca tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] Returning 404 to user: Instance 801d8c8a-8534-43b5-a61f-347cbf9418b5 could not be found. {{(pid=116375) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 02:16:35.478969 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-092d804e-1175-4732-a495-6e258a5d75ca tempest-VolumesSnapshotTestJSON-1917118355 tempest-VolumesSnapshotTestJSON-1917118355-project] 10.222.0.79 "GET /compute/v2.1/servers/801d8c8a-8534-43b5-a61f-347cbf9418b5" status: 404 len: 111 microversion: 2.1 time: 0.027254 Jan 28 02:16:35.479508 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 593/1229] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:16:35 2022] GET /compute/v2.1/servers/801d8c8a-8534-43b5-a61f-347cbf9418b5 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 02:17:09.309670 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-ebb560a2-06f0-443c-b90a-daf327b80ad6 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-983515433", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-710989458", "security_groups": [{"name": "tempest-secgroup-smoke-152893613"}], "block_device_mapping_v2": [{"uuid": "0059dd5c-b525-480e-b07f-7492ebe00f10", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "7bcf169f-11e9-43c3-9cd8-36fa37c1812f"}]}} {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:17:09.414226 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.network.neutron [None req-ebb560a2-06f0-443c-b90a-daf327b80ad6 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] validate_networks() for [('7bcf169f-11e9-43c3-9cd8-36fa37c1812f', None, None, None, None, None)] {{(pid=116374) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Jan 28 02:17:09.890067 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.virt.hardware [None req-ebb560a2-06f0-443c-b90a-daf327b80ad6 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Flavor limits 0:0:0 {{(pid=116374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 02:17:09.890487 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.virt.hardware [None req-ebb560a2-06f0-443c-b90a-daf327b80ad6 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Image limits 0:0:0 {{(pid=116374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 02:17:09.890953 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.virt.hardware [None req-ebb560a2-06f0-443c-b90a-daf327b80ad6 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Flavor pref 0:0:0 {{(pid=116374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 02:17:09.891363 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.virt.hardware [None req-ebb560a2-06f0-443c-b90a-daf327b80ad6 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Image pref 0:0:0 {{(pid=116374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 02:17:09.891770 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.virt.hardware [None req-ebb560a2-06f0-443c-b90a-daf327b80ad6 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116374) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 02:17:09.901223 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-ebb560a2-06f0-443c-b90a-daf327b80ad6 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:17:09.901660 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-ebb560a2-06f0-443c-b90a-daf327b80ad6 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:17:09.902461 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-ebb560a2-06f0-443c-b90a-daf327b80ad6 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:17:09.902893 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-ebb560a2-06f0-443c-b90a-daf327b80ad6 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:17:09.923097 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.quota [None req-ebb560a2-06f0-443c-b90a-daf327b80ad6 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Getting quotas for project 7ed8db325d13496c9a417966e33b10a1. Resources: {'ram', 'cores', 'instances'} {{(pid=116374) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 02:17:09.927672 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.quota [None req-ebb560a2-06f0-443c-b90a-daf327b80ad6 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Getting quotas for user 4cdbf7d369e4437eae7a36529d6cd623 and project 7ed8db325d13496c9a417966e33b10a1. Resources: {'ram', 'cores', 'instances'} {{(pid=116374) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 02:17:09.989325 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-ebb560a2-06f0-443c-b90a-daf327b80ad6 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Going to run 1 instances... {{(pid=116374) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 02:17:09.991455 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-ebb560a2-06f0-443c-b90a-daf327b80ad6 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] [instance: 10bb7902-287b-4b8b-86bf-a6f0c5354249] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0059dd5c-b525-480e-b07f-7492ebe00f10',volume_size=None,volume_type=None)] {{(pid=116374) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 02:17:10.411496 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-ebb560a2-06f0-443c-b90a-daf327b80ad6 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.105680 Jan 28 02:17:10.412250 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 637/1230] 10.222.0.79 () {60 vars in 1146 bytes} [Fri Jan 28 02:17:09 2022] POST /compute/v2.1/servers => generated 405 bytes in 1107 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jan 28 02:17:10.422043 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-f83a1e45-b964-49f4-a2ec-c6b5191501ac tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:17:10.422665 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-f83a1e45-b964-49f4-a2ec-c6b5191501ac tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] [instance: 10bb7902-287b-4b8b-86bf-a6f0c5354249] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:17:10.478929 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-f83a1e45-b964-49f4-a2ec-c6b5191501ac tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cdbf7d369e4437eae7a36529d6cd623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed8db325d13496c9a417966e33b10a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:17:10.485324 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-f83a1e45-b964-49f4-a2ec-c6b5191501ac tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] 10.222.0.79 "GET /compute/v2.1/servers/10bb7902-287b-4b8b-86bf-a6f0c5354249" status: 200 len: 1093 microversion: 2.1 time: 0.067085 Jan 28 02:17:10.485890 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 594/1231] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:17:10 2022] GET /compute/v2.1/servers/10bb7902-287b-4b8b-86bf-a6f0c5354249 => generated 1093 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:17:11.504274 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-e55294dc-8f98-4a99-a80e-7406595ea2a5 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:17:11.505009 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-e55294dc-8f98-4a99-a80e-7406595ea2a5 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] [instance: 10bb7902-287b-4b8b-86bf-a6f0c5354249] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:17:11.512306 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-e55294dc-8f98-4a99-a80e-7406595ea2a5 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:17:11.512865 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-e55294dc-8f98-4a99-a80e-7406595ea2a5 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:17:11.513668 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-e55294dc-8f98-4a99-a80e-7406595ea2a5 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:17:11.514644 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-e55294dc-8f98-4a99-a80e-7406595ea2a5 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:17:11.585260 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-e55294dc-8f98-4a99-a80e-7406595ea2a5 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cdbf7d369e4437eae7a36529d6cd623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed8db325d13496c9a417966e33b10a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:17:11.592769 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-e55294dc-8f98-4a99-a80e-7406595ea2a5 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] 10.222.0.79 "GET /compute/v2.1/servers/10bb7902-287b-4b8b-86bf-a6f0c5354249" status: 200 len: 1143 microversion: 2.1 time: 0.093727 Jan 28 02:17:11.594571 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 638/1232] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:17:11 2022] GET /compute/v2.1/servers/10bb7902-287b-4b8b-86bf-a6f0c5354249 => generated 1143 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:17:12.609979 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-68a30798-5517-4f86-9327-e54a45a13d2f tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:17:12.610757 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-68a30798-5517-4f86-9327-e54a45a13d2f tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] [instance: 10bb7902-287b-4b8b-86bf-a6f0c5354249] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:17:12.617375 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-68a30798-5517-4f86-9327-e54a45a13d2f tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:17:12.618046 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-68a30798-5517-4f86-9327-e54a45a13d2f tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:17:12.619056 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-68a30798-5517-4f86-9327-e54a45a13d2f tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:17:12.619558 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-68a30798-5517-4f86-9327-e54a45a13d2f tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:17:12.694793 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-68a30798-5517-4f86-9327-e54a45a13d2f tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cdbf7d369e4437eae7a36529d6cd623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed8db325d13496c9a417966e33b10a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:17:12.704178 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-68a30798-5517-4f86-9327-e54a45a13d2f tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] 10.222.0.79 "GET /compute/v2.1/servers/10bb7902-287b-4b8b-86bf-a6f0c5354249" status: 200 len: 1199 microversion: 2.1 time: 0.098025 Jan 28 02:17:12.713885 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 595/1233] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:17:12 2022] GET /compute/v2.1/servers/10bb7902-287b-4b8b-86bf-a6f0c5354249 => generated 1199 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:17:13.722047 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-4dedae7d-1658-418c-9000-fe4cdd411b5c tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:17:13.722934 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-4dedae7d-1658-418c-9000-fe4cdd411b5c tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] [instance: 10bb7902-287b-4b8b-86bf-a6f0c5354249] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:17:13.730285 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-4dedae7d-1658-418c-9000-fe4cdd411b5c tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:17:13.730736 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-4dedae7d-1658-418c-9000-fe4cdd411b5c tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:17:13.731718 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-4dedae7d-1658-418c-9000-fe4cdd411b5c tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:17:13.732343 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-4dedae7d-1658-418c-9000-fe4cdd411b5c tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:17:13.918621 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-4dedae7d-1658-418c-9000-fe4cdd411b5c tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cdbf7d369e4437eae7a36529d6cd623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed8db325d13496c9a417966e33b10a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:17:13.926816 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-4dedae7d-1658-418c-9000-fe4cdd411b5c tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] 10.222.0.79 "GET /compute/v2.1/servers/10bb7902-287b-4b8b-86bf-a6f0c5354249" status: 200 len: 1276 microversion: 2.1 time: 0.208552 Jan 28 02:17:13.929256 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 639/1234] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:17:13 2022] GET /compute/v2.1/servers/10bb7902-287b-4b8b-86bf-a6f0c5354249 => generated 1276 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:17:14.340300 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [req-b6e43948-0aa7-4a29-833a-c963e6665269 req-5d74b1b5-4b47-436b-b8ed-c4203dc55380 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10bb7902-287b-4b8b-86bf-a6f0c5354249", "tag": "dbf2b58a-38d3-4f4c-b7dc-134dcf5043a6"}]} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:17:14.341926 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:17:14.341926 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: warnings.warn(msg) Jan 28 02:17:14.350231 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-b6e43948-0aa7-4a29-833a-c963e6665269 req-5d74b1b5-4b47-436b-b8ed-c4203dc55380 service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:17:14.351210 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-b6e43948-0aa7-4a29-833a-c963e6665269 req-5d74b1b5-4b47-436b-b8ed-c4203dc55380 service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:17:14.363904 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.compute.server_external_events [req-b6e43948-0aa7-4a29-833a-c963e6665269 req-5d74b1b5-4b47-436b-b8ed-c4203dc55380 service nova] Creating event network-changed:dbf2b58a-38d3-4f4c-b7dc-134dcf5043a6 for instance 10bb7902-287b-4b8b-86bf-a6f0c5354249 on hv-cinder-82497 Jan 28 02:17:14.369666 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [req-b6e43948-0aa7-4a29-833a-c963e6665269 req-5d74b1b5-4b47-436b-b8ed-c4203dc55380 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034295 Jan 28 02:17:14.370265 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 596/1235] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Jan 28 02:17:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 02:17:14.944107 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-881dddbc-7389-4a88-b928-6709ee9790bf tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:17:14.945332 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-881dddbc-7389-4a88-b928-6709ee9790bf tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] [instance: 10bb7902-287b-4b8b-86bf-a6f0c5354249] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:17:14.951039 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-881dddbc-7389-4a88-b928-6709ee9790bf tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:17:14.951481 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-881dddbc-7389-4a88-b928-6709ee9790bf tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:17:14.952283 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-881dddbc-7389-4a88-b928-6709ee9790bf tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:17:14.952713 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-881dddbc-7389-4a88-b928-6709ee9790bf tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:17:15.133599 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-881dddbc-7389-4a88-b928-6709ee9790bf tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cdbf7d369e4437eae7a36529d6cd623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed8db325d13496c9a417966e33b10a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:17:15.141266 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-881dddbc-7389-4a88-b928-6709ee9790bf tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] 10.222.0.79 "GET /compute/v2.1/servers/10bb7902-287b-4b8b-86bf-a6f0c5354249" status: 200 len: 1264 microversion: 2.1 time: 0.201324 Jan 28 02:17:15.150907 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 640/1236] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:17:14 2022] GET /compute/v2.1/servers/10bb7902-287b-4b8b-86bf-a6f0c5354249 => generated 1264 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:17:16.158867 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-d0e253ac-a68b-4208-bf56-a13b5569d2d2 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:17:16.159551 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-d0e253ac-a68b-4208-bf56-a13b5569d2d2 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] [instance: 10bb7902-287b-4b8b-86bf-a6f0c5354249] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:17:16.166774 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-d0e253ac-a68b-4208-bf56-a13b5569d2d2 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:17:16.167212 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-d0e253ac-a68b-4208-bf56-a13b5569d2d2 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:17:16.167997 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-d0e253ac-a68b-4208-bf56-a13b5569d2d2 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:17:16.168422 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-d0e253ac-a68b-4208-bf56-a13b5569d2d2 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:17:16.285975 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-d0e253ac-a68b-4208-bf56-a13b5569d2d2 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cdbf7d369e4437eae7a36529d6cd623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed8db325d13496c9a417966e33b10a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:17:16.293040 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-d0e253ac-a68b-4208-bf56-a13b5569d2d2 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] 10.222.0.79 "GET /compute/v2.1/servers/10bb7902-287b-4b8b-86bf-a6f0c5354249" status: 200 len: 1264 microversion: 2.1 time: 0.138409 Jan 28 02:17:16.293598 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 597/1237] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:17:16 2022] GET /compute/v2.1/servers/10bb7902-287b-4b8b-86bf-a6f0c5354249 => generated 1264 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:17:17.309609 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-b7be0a8c-0cde-4468-affd-1d9d5854f600 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:17:17.310189 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-b7be0a8c-0cde-4468-affd-1d9d5854f600 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] [instance: 10bb7902-287b-4b8b-86bf-a6f0c5354249] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:17:17.316234 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-b7be0a8c-0cde-4468-affd-1d9d5854f600 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:17:17.316684 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-b7be0a8c-0cde-4468-affd-1d9d5854f600 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:17:17.317435 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-b7be0a8c-0cde-4468-affd-1d9d5854f600 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:17:17.317858 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-b7be0a8c-0cde-4468-affd-1d9d5854f600 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:17:17.437546 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-b7be0a8c-0cde-4468-affd-1d9d5854f600 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cdbf7d369e4437eae7a36529d6cd623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed8db325d13496c9a417966e33b10a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:17:17.445116 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-b7be0a8c-0cde-4468-affd-1d9d5854f600 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] 10.222.0.79 "GET /compute/v2.1/servers/10bb7902-287b-4b8b-86bf-a6f0c5354249" status: 200 len: 1264 microversion: 2.1 time: 0.139220 Jan 28 02:17:17.445673 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 641/1238] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:17:17 2022] GET /compute/v2.1/servers/10bb7902-287b-4b8b-86bf-a6f0c5354249 => generated 1264 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:17:18.463308 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-a30ee70f-6ee6-4f48-84de-a7c95d62a981 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:17:18.463941 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-a30ee70f-6ee6-4f48-84de-a7c95d62a981 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] [instance: 10bb7902-287b-4b8b-86bf-a6f0c5354249] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:17:18.469761 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a30ee70f-6ee6-4f48-84de-a7c95d62a981 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:17:18.470199 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a30ee70f-6ee6-4f48-84de-a7c95d62a981 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:17:18.471333 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a30ee70f-6ee6-4f48-84de-a7c95d62a981 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:17:18.471803 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-a30ee70f-6ee6-4f48-84de-a7c95d62a981 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:17:18.588910 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-a30ee70f-6ee6-4f48-84de-a7c95d62a981 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cdbf7d369e4437eae7a36529d6cd623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed8db325d13496c9a417966e33b10a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:17:18.596500 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-a30ee70f-6ee6-4f48-84de-a7c95d62a981 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] 10.222.0.79 "GET /compute/v2.1/servers/10bb7902-287b-4b8b-86bf-a6f0c5354249" status: 200 len: 1264 microversion: 2.1 time: 0.137659 Jan 28 02:17:18.597171 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 598/1239] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:17:18 2022] GET /compute/v2.1/servers/10bb7902-287b-4b8b-86bf-a6f0c5354249 => generated 1264 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:17:19.613534 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-a46c3352-ce38-4baf-9040-8fdd63c9aab7 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:17:19.614131 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-a46c3352-ce38-4baf-9040-8fdd63c9aab7 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] [instance: 10bb7902-287b-4b8b-86bf-a6f0c5354249] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:17:19.619993 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-a46c3352-ce38-4baf-9040-8fdd63c9aab7 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:17:19.620444 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-a46c3352-ce38-4baf-9040-8fdd63c9aab7 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:17:19.621197 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-a46c3352-ce38-4baf-9040-8fdd63c9aab7 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:17:19.621623 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-a46c3352-ce38-4baf-9040-8fdd63c9aab7 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:17:19.737897 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-a46c3352-ce38-4baf-9040-8fdd63c9aab7 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cdbf7d369e4437eae7a36529d6cd623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed8db325d13496c9a417966e33b10a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:17:19.745006 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-a46c3352-ce38-4baf-9040-8fdd63c9aab7 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] 10.222.0.79 "GET /compute/v2.1/servers/10bb7902-287b-4b8b-86bf-a6f0c5354249" status: 200 len: 1264 microversion: 2.1 time: 0.135437 Jan 28 02:17:19.745558 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 642/1240] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:17:19 2022] GET /compute/v2.1/servers/10bb7902-287b-4b8b-86bf-a6f0c5354249 => generated 1264 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:17:20.762012 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-b3aa2b20-0857-4dbe-b67f-6023bcc95b9f tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:17:20.762623 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-b3aa2b20-0857-4dbe-b67f-6023bcc95b9f tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] [instance: 10bb7902-287b-4b8b-86bf-a6f0c5354249] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:17:20.768336 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b3aa2b20-0857-4dbe-b67f-6023bcc95b9f tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:17:20.768782 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b3aa2b20-0857-4dbe-b67f-6023bcc95b9f tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:17:20.769525 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b3aa2b20-0857-4dbe-b67f-6023bcc95b9f tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:17:20.769947 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-b3aa2b20-0857-4dbe-b67f-6023bcc95b9f tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:17:20.890801 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-b3aa2b20-0857-4dbe-b67f-6023bcc95b9f tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cdbf7d369e4437eae7a36529d6cd623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed8db325d13496c9a417966e33b10a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:17:20.898505 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-b3aa2b20-0857-4dbe-b67f-6023bcc95b9f tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] 10.222.0.79 "GET /compute/v2.1/servers/10bb7902-287b-4b8b-86bf-a6f0c5354249" status: 200 len: 1264 microversion: 2.1 time: 0.140154 Jan 28 02:17:20.899060 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 599/1241] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:17:20 2022] GET /compute/v2.1/servers/10bb7902-287b-4b8b-86bf-a6f0c5354249 => generated 1264 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:17:21.915068 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-01926e16-f1e7-417e-b2b0-38e38642af20 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:17:21.915793 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-01926e16-f1e7-417e-b2b0-38e38642af20 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] [instance: 10bb7902-287b-4b8b-86bf-a6f0c5354249] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:17:21.921767 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-01926e16-f1e7-417e-b2b0-38e38642af20 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:17:21.922207 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-01926e16-f1e7-417e-b2b0-38e38642af20 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:17:21.922971 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-01926e16-f1e7-417e-b2b0-38e38642af20 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:17:21.923397 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-01926e16-f1e7-417e-b2b0-38e38642af20 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:17:22.045721 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-01926e16-f1e7-417e-b2b0-38e38642af20 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cdbf7d369e4437eae7a36529d6cd623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed8db325d13496c9a417966e33b10a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:17:22.053694 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-01926e16-f1e7-417e-b2b0-38e38642af20 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] 10.222.0.79 "GET /compute/v2.1/servers/10bb7902-287b-4b8b-86bf-a6f0c5354249" status: 200 len: 1264 microversion: 2.1 time: 0.142453 Jan 28 02:17:22.054252 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 643/1242] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:17:21 2022] GET /compute/v2.1/servers/10bb7902-287b-4b8b-86bf-a6f0c5354249 => generated 1264 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:17:23.070737 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-32301106-b350-4f13-a2f2-a1d9113bd1d9 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:17:23.071365 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-32301106-b350-4f13-a2f2-a1d9113bd1d9 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] [instance: 10bb7902-287b-4b8b-86bf-a6f0c5354249] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:17:23.077183 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-32301106-b350-4f13-a2f2-a1d9113bd1d9 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:17:23.077621 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-32301106-b350-4f13-a2f2-a1d9113bd1d9 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:17:23.078378 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-32301106-b350-4f13-a2f2-a1d9113bd1d9 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:17:23.078801 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-32301106-b350-4f13-a2f2-a1d9113bd1d9 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:17:23.197041 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-32301106-b350-4f13-a2f2-a1d9113bd1d9 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cdbf7d369e4437eae7a36529d6cd623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed8db325d13496c9a417966e33b10a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:17:23.204245 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-32301106-b350-4f13-a2f2-a1d9113bd1d9 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] 10.222.0.79 "GET /compute/v2.1/servers/10bb7902-287b-4b8b-86bf-a6f0c5354249" status: 200 len: 1264 microversion: 2.1 time: 0.137195 Jan 28 02:17:23.204860 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 600/1243] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:17:23 2022] GET /compute/v2.1/servers/10bb7902-287b-4b8b-86bf-a6f0c5354249 => generated 1264 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:17:24.222451 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-dd9ac0ba-4077-406b-b065-100a48d7cdac tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:17:24.223338 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-dd9ac0ba-4077-406b-b065-100a48d7cdac tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] [instance: 10bb7902-287b-4b8b-86bf-a6f0c5354249] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:17:24.229456 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-dd9ac0ba-4077-406b-b065-100a48d7cdac tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:17:24.229893 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-dd9ac0ba-4077-406b-b065-100a48d7cdac tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:17:24.230693 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-dd9ac0ba-4077-406b-b065-100a48d7cdac tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:17:24.231119 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-dd9ac0ba-4077-406b-b065-100a48d7cdac tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:17:24.353965 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-dd9ac0ba-4077-406b-b065-100a48d7cdac tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cdbf7d369e4437eae7a36529d6cd623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed8db325d13496c9a417966e33b10a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:17:24.361295 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-dd9ac0ba-4077-406b-b065-100a48d7cdac tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] 10.222.0.79 "GET /compute/v2.1/servers/10bb7902-287b-4b8b-86bf-a6f0c5354249" status: 200 len: 1264 microversion: 2.1 time: 0.143579 Jan 28 02:17:24.361916 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 644/1244] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:17:24 2022] GET /compute/v2.1/servers/10bb7902-287b-4b8b-86bf-a6f0c5354249 => generated 1264 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:17:25.378116 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-1b129d6d-0f33-4935-91e9-4b6a8acdd09b tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:17:25.378714 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-1b129d6d-0f33-4935-91e9-4b6a8acdd09b tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] [instance: 10bb7902-287b-4b8b-86bf-a6f0c5354249] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:17:25.385375 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-1b129d6d-0f33-4935-91e9-4b6a8acdd09b tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:17:25.385756 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-1b129d6d-0f33-4935-91e9-4b6a8acdd09b tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:17:25.386509 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-1b129d6d-0f33-4935-91e9-4b6a8acdd09b tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:17:25.386933 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-1b129d6d-0f33-4935-91e9-4b6a8acdd09b tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:17:25.510039 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-1b129d6d-0f33-4935-91e9-4b6a8acdd09b tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cdbf7d369e4437eae7a36529d6cd623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed8db325d13496c9a417966e33b10a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:17:25.517372 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-1b129d6d-0f33-4935-91e9-4b6a8acdd09b tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] 10.222.0.79 "GET /compute/v2.1/servers/10bb7902-287b-4b8b-86bf-a6f0c5354249" status: 200 len: 1264 microversion: 2.1 time: 0.143695 Jan 28 02:17:25.517937 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 601/1245] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:17:25 2022] GET /compute/v2.1/servers/10bb7902-287b-4b8b-86bf-a6f0c5354249 => generated 1264 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:17:26.193792 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [req-7152eed7-45db-4a9f-9e7b-a370060c28bb req-7daa63a4-cd06-42eb-a99c-ed57e4fe6dc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10bb7902-287b-4b8b-86bf-a6f0c5354249", "name": "network-vif-plugged", "status": "completed", "tag": "dbf2b58a-38d3-4f4c-b7dc-134dcf5043a6"}]} {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:17:26.195401 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:17:26.195401 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: warnings.warn(msg) Jan 28 02:17:26.203014 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [req-7152eed7-45db-4a9f-9e7b-a370060c28bb req-7daa63a4-cd06-42eb-a99c-ed57e4fe6dc8 service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:17:26.203450 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [req-7152eed7-45db-4a9f-9e7b-a370060c28bb req-7daa63a4-cd06-42eb-a99c-ed57e4fe6dc8 service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:17:26.216232 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.compute.server_external_events [req-7152eed7-45db-4a9f-9e7b-a370060c28bb req-7daa63a4-cd06-42eb-a99c-ed57e4fe6dc8 service nova] Creating event network-vif-plugged:dbf2b58a-38d3-4f4c-b7dc-134dcf5043a6 for instance 10bb7902-287b-4b8b-86bf-a6f0c5354249 on hv-cinder-82497 Jan 28 02:17:26.224653 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [req-7152eed7-45db-4a9f-9e7b-a370060c28bb req-7daa63a4-cd06-42eb-a99c-ed57e4fe6dc8 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.166630 Jan 28 02:17:26.225628 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 645/1246] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Jan 28 02:17:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:17:26.533526 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-f1275328-1628-47aa-a27e-a1ef0c3d6419 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:17:26.534142 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-f1275328-1628-47aa-a27e-a1ef0c3d6419 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] [instance: 10bb7902-287b-4b8b-86bf-a6f0c5354249] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:17:26.540075 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f1275328-1628-47aa-a27e-a1ef0c3d6419 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:17:26.540521 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f1275328-1628-47aa-a27e-a1ef0c3d6419 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:17:26.541282 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f1275328-1628-47aa-a27e-a1ef0c3d6419 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:17:26.541711 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-f1275328-1628-47aa-a27e-a1ef0c3d6419 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:17:26.714050 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-f1275328-1628-47aa-a27e-a1ef0c3d6419 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cdbf7d369e4437eae7a36529d6cd623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed8db325d13496c9a417966e33b10a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:17:26.721562 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-f1275328-1628-47aa-a27e-a1ef0c3d6419 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] 10.222.0.79 "GET /compute/v2.1/servers/10bb7902-287b-4b8b-86bf-a6f0c5354249" status: 200 len: 1264 microversion: 2.1 time: 0.191857 Jan 28 02:17:26.722125 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 602/1247] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:17:26 2022] GET /compute/v2.1/servers/10bb7902-287b-4b8b-86bf-a6f0c5354249 => generated 1264 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:17:27.739023 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-73fa7526-0991-45f9-aa3a-109721158665 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:17:27.739701 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-73fa7526-0991-45f9-aa3a-109721158665 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] [instance: 10bb7902-287b-4b8b-86bf-a6f0c5354249] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:17:27.745763 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-73fa7526-0991-45f9-aa3a-109721158665 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:17:27.746273 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-73fa7526-0991-45f9-aa3a-109721158665 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:17:27.746988 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-73fa7526-0991-45f9-aa3a-109721158665 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:17:27.747410 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-73fa7526-0991-45f9-aa3a-109721158665 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:17:27.870547 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-73fa7526-0991-45f9-aa3a-109721158665 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cdbf7d369e4437eae7a36529d6cd623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed8db325d13496c9a417966e33b10a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:17:27.877637 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-73fa7526-0991-45f9-aa3a-109721158665 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] 10.222.0.79 "GET /compute/v2.1/servers/10bb7902-287b-4b8b-86bf-a6f0c5354249" status: 200 len: 1264 microversion: 2.1 time: 0.142759 Jan 28 02:17:27.878190 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 646/1248] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:17:27 2022] GET /compute/v2.1/servers/10bb7902-287b-4b8b-86bf-a6f0c5354249 => generated 1264 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:17:28.894114 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-0f5d5195-b069-4b11-bb62-a935addbc26d tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:17:28.894870 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-0f5d5195-b069-4b11-bb62-a935addbc26d tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] [instance: 10bb7902-287b-4b8b-86bf-a6f0c5354249] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:17:28.900360 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-0f5d5195-b069-4b11-bb62-a935addbc26d tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:17:28.900802 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-0f5d5195-b069-4b11-bb62-a935addbc26d tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:17:28.901593 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-0f5d5195-b069-4b11-bb62-a935addbc26d tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:17:28.902018 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-0f5d5195-b069-4b11-bb62-a935addbc26d tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:17:29.031604 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-0f5d5195-b069-4b11-bb62-a935addbc26d tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cdbf7d369e4437eae7a36529d6cd623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed8db325d13496c9a417966e33b10a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:17:29.039751 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-0f5d5195-b069-4b11-bb62-a935addbc26d tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] 10.222.0.79 "GET /compute/v2.1/servers/10bb7902-287b-4b8b-86bf-a6f0c5354249" status: 200 len: 1451 microversion: 2.1 time: 0.149672 Jan 28 02:17:29.040361 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 603/1249] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:17:28 2022] GET /compute/v2.1/servers/10bb7902-287b-4b8b-86bf-a6f0c5354249 => generated 1451 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:17:29.056528 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-9351951a-bb9f-44cb-86a5-c82ab68a67c8 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:17:29.057141 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-9351951a-bb9f-44cb-86a5-c82ab68a67c8 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] [instance: 10bb7902-287b-4b8b-86bf-a6f0c5354249] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:17:29.062946 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-9351951a-bb9f-44cb-86a5-c82ab68a67c8 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:17:29.063395 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-9351951a-bb9f-44cb-86a5-c82ab68a67c8 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:17:29.064197 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-9351951a-bb9f-44cb-86a5-c82ab68a67c8 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:17:29.064635 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-9351951a-bb9f-44cb-86a5-c82ab68a67c8 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:17:29.192848 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-9351951a-bb9f-44cb-86a5-c82ab68a67c8 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cdbf7d369e4437eae7a36529d6cd623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed8db325d13496c9a417966e33b10a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:17:29.199992 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-9351951a-bb9f-44cb-86a5-c82ab68a67c8 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] 10.222.0.79 "GET /compute/v2.1/servers/10bb7902-287b-4b8b-86bf-a6f0c5354249" status: 200 len: 1451 microversion: 2.1 time: 0.147207 Jan 28 02:17:29.200542 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 647/1250] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:17:29 2022] GET /compute/v2.1/servers/10bb7902-287b-4b8b-86bf-a6f0c5354249 => generated 1451 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:17:31.271501 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [req-b75adc4a-00a7-434a-9faf-9d7162d28a91 req-8bae0239-c71d-49c3-97f4-1d8c102ade25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10bb7902-287b-4b8b-86bf-a6f0c5354249", "tag": "dbf2b58a-38d3-4f4c-b7dc-134dcf5043a6"}]} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:17:31.273051 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:17:31.273051 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: warnings.warn(msg) Jan 28 02:17:31.280170 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-b75adc4a-00a7-434a-9faf-9d7162d28a91 req-8bae0239-c71d-49c3-97f4-1d8c102ade25 service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:17:31.280713 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-b75adc4a-00a7-434a-9faf-9d7162d28a91 req-8bae0239-c71d-49c3-97f4-1d8c102ade25 service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:17:31.292669 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.compute.server_external_events [req-b75adc4a-00a7-434a-9faf-9d7162d28a91 req-8bae0239-c71d-49c3-97f4-1d8c102ade25 service nova] Creating event network-changed:dbf2b58a-38d3-4f4c-b7dc-134dcf5043a6 for instance 10bb7902-287b-4b8b-86bf-a6f0c5354249 on hv-cinder-82497 Jan 28 02:17:31.297652 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [req-b75adc4a-00a7-434a-9faf-9d7162d28a91 req-8bae0239-c71d-49c3-97f4-1d8c102ade25 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029812 Jan 28 02:17:31.298257 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 604/1251] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Jan 28 02:17:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:17:54.315467 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 28 02:17:54.316084 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: Fri Jan 28 02:17:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 28 02:19:11.320195 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c07d990e-2648-4423-989f-b0623d5984a6] AMQP server on 10.222.0.79:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jan 28 02:19:11.324154 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-be85d3c5-51b3-4c17-8dab-7ee33e92693b tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:19:11.324655 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-be85d3c5-51b3-4c17-8dab-7ee33e92693b tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] [instance: 10bb7902-287b-4b8b-86bf-a6f0c5354249] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:19:11.331148 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-be85d3c5-51b3-4c17-8dab-7ee33e92693b tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:19:11.331577 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-be85d3c5-51b3-4c17-8dab-7ee33e92693b tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:19:11.332615 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-be85d3c5-51b3-4c17-8dab-7ee33e92693b tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:19:11.332959 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [req-06f8b2da-d138-407c-82fc-bb929679ad51 req-226bf74d-e466-4c97-a8aa-26369c691dec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10bb7902-287b-4b8b-86bf-a6f0c5354249", "tag": "dbf2b58a-38d3-4f4c-b7dc-134dcf5043a6"}]} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:19:11.333691 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-be85d3c5-51b3-4c17-8dab-7ee33e92693b tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:19:11.334425 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:19:11.334425 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: warnings.warn(msg) Jan 28 02:19:11.343778 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-06f8b2da-d138-407c-82fc-bb929679ad51 req-226bf74d-e466-4c97-a8aa-26369c691dec service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:19:11.344251 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-06f8b2da-d138-407c-82fc-bb929679ad51 req-226bf74d-e466-4c97-a8aa-26369c691dec service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:19:11.355572 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.compute.server_external_events [req-06f8b2da-d138-407c-82fc-bb929679ad51 req-226bf74d-e466-4c97-a8aa-26369c691dec service nova] Creating event network-changed:dbf2b58a-38d3-4f4c-b7dc-134dcf5043a6 for instance 10bb7902-287b-4b8b-86bf-a6f0c5354249 on hv-cinder-82497 Jan 28 02:19:11.360904 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [req-06f8b2da-d138-407c-82fc-bb929679ad51 req-226bf74d-e466-4c97-a8aa-26369c691dec service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033271 Jan 28 02:19:11.361078 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-be85d3c5-51b3-4c17-8dab-7ee33e92693b tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] [instance: 10bb7902-287b-4b8b-86bf-a6f0c5354249] Going to try to terminate instance {{(pid=116374) delete /opt/stack/nova/nova/compute/api.py:2612}} Jan 28 02:19:11.361842 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 605/1252] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Jan 28 02:19:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:19:11.648979 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-be85d3c5-51b3-4c17-8dab-7ee33e92693b tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] 10.222.0.79 "DELETE /compute/v2.1/servers/10bb7902-287b-4b8b-86bf-a6f0c5354249" status: 204 len: 0 microversion: 2.1 time: 0.330241 Jan 28 02:19:11.649715 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 648/1253] 10.222.0.79 () {58 vars in 1238 bytes} [Fri Jan 28 02:19:11 2022] DELETE /compute/v2.1/servers/10bb7902-287b-4b8b-86bf-a6f0c5354249 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 28 02:19:11.659149 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-79d4fe97-da16-4463-9b85-2f2ed4d8f5cd tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:19:11.660495 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-79d4fe97-da16-4463-9b85-2f2ed4d8f5cd tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] [instance: 10bb7902-287b-4b8b-86bf-a6f0c5354249] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:19:11.668993 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-79d4fe97-da16-4463-9b85-2f2ed4d8f5cd tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:19:11.669450 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-79d4fe97-da16-4463-9b85-2f2ed4d8f5cd tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:19:11.670254 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-79d4fe97-da16-4463-9b85-2f2ed4d8f5cd tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:19:11.670896 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-79d4fe97-da16-4463-9b85-2f2ed4d8f5cd tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:19:11.877867 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-79d4fe97-da16-4463-9b85-2f2ed4d8f5cd tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cdbf7d369e4437eae7a36529d6cd623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed8db325d13496c9a417966e33b10a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:19:11.888382 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-79d4fe97-da16-4463-9b85-2f2ed4d8f5cd tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] 10.222.0.79 "GET /compute/v2.1/servers/10bb7902-287b-4b8b-86bf-a6f0c5354249" status: 200 len: 1575 microversion: 2.1 time: 0.233577 Jan 28 02:19:11.889264 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 606/1254] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:19:11 2022] GET /compute/v2.1/servers/10bb7902-287b-4b8b-86bf-a6f0c5354249 => generated 1575 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:19:12.907495 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-de3e7361-8099-48a5-9530-5905e840faae tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:19:12.908217 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-de3e7361-8099-48a5-9530-5905e840faae tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] [instance: 10bb7902-287b-4b8b-86bf-a6f0c5354249] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:19:12.915523 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-de3e7361-8099-48a5-9530-5905e840faae tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:19:12.915986 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-de3e7361-8099-48a5-9530-5905e840faae tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:19:12.916761 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-de3e7361-8099-48a5-9530-5905e840faae tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:19:12.917347 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-de3e7361-8099-48a5-9530-5905e840faae tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:19:12.922598 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO oslo.messaging._drivers.impl_rabbit [-] [c07d990e-2648-4423-989f-b0623d5984a6] Reconnected to AMQP server on 10.222.0.79:5672 via [amqp] client with port 42116. Jan 28 02:19:13.044238 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-de3e7361-8099-48a5-9530-5905e840faae tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cdbf7d369e4437eae7a36529d6cd623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed8db325d13496c9a417966e33b10a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:19:13.051747 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-de3e7361-8099-48a5-9530-5905e840faae tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] 10.222.0.79 "GET /compute/v2.1/servers/10bb7902-287b-4b8b-86bf-a6f0c5354249" status: 200 len: 1457 microversion: 2.1 time: 0.148447 Jan 28 02:19:13.052350 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 649/1255] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:19:12 2022] GET /compute/v2.1/servers/10bb7902-287b-4b8b-86bf-a6f0c5354249 => generated 1457 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 02:19:14.069525 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-1c3978d6-2a23-4f6e-977d-719ff8b6bebc tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:19:14.070186 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-1c3978d6-2a23-4f6e-977d-719ff8b6bebc tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] [instance: 10bb7902-287b-4b8b-86bf-a6f0c5354249] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:19:14.076109 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-1c3978d6-2a23-4f6e-977d-719ff8b6bebc tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:19:14.076611 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-1c3978d6-2a23-4f6e-977d-719ff8b6bebc tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:19:14.077484 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-1c3978d6-2a23-4f6e-977d-719ff8b6bebc tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:19:14.078002 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-1c3978d6-2a23-4f6e-977d-719ff8b6bebc tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:19:14.227434 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-1c3978d6-2a23-4f6e-977d-719ff8b6bebc tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cdbf7d369e4437eae7a36529d6cd623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed8db325d13496c9a417966e33b10a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:19:14.235153 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-1c3978d6-2a23-4f6e-977d-719ff8b6bebc tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] 10.222.0.79 "GET /compute/v2.1/servers/10bb7902-287b-4b8b-86bf-a6f0c5354249" status: 200 len: 1457 microversion: 2.1 time: 0.169387 Jan 28 02:19:14.235717 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 607/1256] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:19:14 2022] GET /compute/v2.1/servers/10bb7902-287b-4b8b-86bf-a6f0c5354249 => generated 1457 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:19:14.331828 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [req-180088a1-aeec-4385-9ff0-d6f81263e738 req-63140d32-04ed-422f-91a7-33fd3833a164 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10bb7902-287b-4b8b-86bf-a6f0c5354249", "name": "network-vif-deleted", "tag": "dbf2b58a-38d3-4f4c-b7dc-134dcf5043a6"}]} {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:19:14.333328 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:19:14.333328 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: warnings.warn(msg) Jan 28 02:19:14.340686 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [req-180088a1-aeec-4385-9ff0-d6f81263e738 req-63140d32-04ed-422f-91a7-33fd3833a164 service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:19:14.341125 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [req-180088a1-aeec-4385-9ff0-d6f81263e738 req-63140d32-04ed-422f-91a7-33fd3833a164 service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:19:14.351691 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.compute.server_external_events [req-180088a1-aeec-4385-9ff0-d6f81263e738 req-63140d32-04ed-422f-91a7-33fd3833a164 service nova] Creating event network-vif-deleted:dbf2b58a-38d3-4f4c-b7dc-134dcf5043a6 for instance 10bb7902-287b-4b8b-86bf-a6f0c5354249 on hv-cinder-82497 Jan 28 02:19:14.357580 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [req-180088a1-aeec-4385-9ff0-d6f81263e738 req-63140d32-04ed-422f-91a7-33fd3833a164 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029341 Jan 28 02:19:14.358157 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 650/1257] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Jan 28 02:19:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:19:15.252265 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-ea3f6e1a-0ee3-46f8-8340-9e1b8bfbf459 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:19:15.252874 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-ea3f6e1a-0ee3-46f8-8340-9e1b8bfbf459 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] [instance: 10bb7902-287b-4b8b-86bf-a6f0c5354249] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:19:15.258820 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ea3f6e1a-0ee3-46f8-8340-9e1b8bfbf459 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:19:15.259273 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ea3f6e1a-0ee3-46f8-8340-9e1b8bfbf459 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:19:15.260345 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ea3f6e1a-0ee3-46f8-8340-9e1b8bfbf459 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:19:15.260791 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ea3f6e1a-0ee3-46f8-8340-9e1b8bfbf459 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:19:15.290290 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ea3f6e1a-0ee3-46f8-8340-9e1b8bfbf459 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:19:15.290731 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-ea3f6e1a-0ee3-46f8-8340-9e1b8bfbf459 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:19:15.291197 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.objects.instance [None req-ea3f6e1a-0ee3-46f8-8340-9e1b8bfbf459 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lazy-loading 'fault' on Instance uuid 10bb7902-287b-4b8b-86bf-a6f0c5354249 {{(pid=116375) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jan 28 02:19:15.333058 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-ea3f6e1a-0ee3-46f8-8340-9e1b8bfbf459 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cdbf7d369e4437eae7a36529d6cd623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed8db325d13496c9a417966e33b10a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:19:15.340768 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-ea3f6e1a-0ee3-46f8-8340-9e1b8bfbf459 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] 10.222.0.79 "GET /compute/v2.1/servers/10bb7902-287b-4b8b-86bf-a6f0c5354249" status: 200 len: 1229 microversion: 2.1 time: 0.092314 Jan 28 02:19:15.341328 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 608/1258] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:19:15 2022] GET /compute/v2.1/servers/10bb7902-287b-4b8b-86bf-a6f0c5354249 => generated 1229 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:19:16.359002 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-dade7f94-7971-49d7-9c3c-4a061332961b tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:19:16.359809 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-dade7f94-7971-49d7-9c3c-4a061332961b tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] [instance: 10bb7902-287b-4b8b-86bf-a6f0c5354249] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:19:16.366200 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-dade7f94-7971-49d7-9c3c-4a061332961b tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:19:16.366642 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-dade7f94-7971-49d7-9c3c-4a061332961b tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:19:16.367411 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-dade7f94-7971-49d7-9c3c-4a061332961b tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:19:16.367846 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-dade7f94-7971-49d7-9c3c-4a061332961b tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:19:16.382625 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.wsgi [None req-dade7f94-7971-49d7-9c3c-4a061332961b tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] HTTP exception thrown: Instance 10bb7902-287b-4b8b-86bf-a6f0c5354249 could not be found. Jan 28 02:19:16.383222 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-dade7f94-7971-49d7-9c3c-4a061332961b tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Returning 404 to user: Instance 10bb7902-287b-4b8b-86bf-a6f0c5354249 could not be found. {{(pid=116374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 02:19:16.384113 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-dade7f94-7971-49d7-9c3c-4a061332961b tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] 10.222.0.79 "GET /compute/v2.1/servers/10bb7902-287b-4b8b-86bf-a6f0c5354249" status: 404 len: 111 microversion: 2.1 time: 0.029684 Jan 28 02:19:16.384674 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 651/1259] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:19:16 2022] GET /compute/v2.1/servers/10bb7902-287b-4b8b-86bf-a6f0c5354249 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 02:19:19.893218 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-3c0c0aa7-385c-481d-ae2c-a4c31dabc847 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:19:19.894768 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-3c0c0aa7-385c-481d-ae2c-a4c31dabc847 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] [instance: 678b2127-dbf6-4985-93ba-1171bae26d88] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:19:19.898551 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [req-dd1ad0c0-590b-4395-a18d-13b833f9bf27 req-32619e93-871c-4680-a447-99d564f52958 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "678b2127-dbf6-4985-93ba-1171bae26d88", "tag": "41e411b1-116e-434d-a378-dd8425c82364"}]} {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:19:19.900103 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:19:19.900103 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: warnings.warn(msg) Jan 28 02:19:19.901485 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-3c0c0aa7-385c-481d-ae2c-a4c31dabc847 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:19:19.902024 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-3c0c0aa7-385c-481d-ae2c-a4c31dabc847 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:19:19.902896 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-3c0c0aa7-385c-481d-ae2c-a4c31dabc847 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:19:19.903664 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-3c0c0aa7-385c-481d-ae2c-a4c31dabc847 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:19:19.907290 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [req-dd1ad0c0-590b-4395-a18d-13b833f9bf27 req-32619e93-871c-4680-a447-99d564f52958 service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:19:19.911102 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [req-dd1ad0c0-590b-4395-a18d-13b833f9bf27 req-32619e93-871c-4680-a447-99d564f52958 service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:19:19.922753 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.compute.server_external_events [req-dd1ad0c0-590b-4395-a18d-13b833f9bf27 req-32619e93-871c-4680-a447-99d564f52958 service nova] Creating event network-changed:41e411b1-116e-434d-a378-dd8425c82364 for instance 678b2127-dbf6-4985-93ba-1171bae26d88 on hv-cinder-82497 Jan 28 02:19:19.928204 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [req-dd1ad0c0-590b-4395-a18d-13b833f9bf27 req-32619e93-871c-4680-a447-99d564f52958 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033126 Jan 28 02:19:19.929079 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 652/1260] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Jan 28 02:19:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:19:19.931885 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-3c0c0aa7-385c-481d-ae2c-a4c31dabc847 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] [instance: 678b2127-dbf6-4985-93ba-1171bae26d88] Going to try to terminate instance {{(pid=116375) delete /opt/stack/nova/nova/compute/api.py:2612}} Jan 28 02:19:20.221576 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-3c0c0aa7-385c-481d-ae2c-a4c31dabc847 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] 10.222.0.79 "DELETE /compute/v2.1/servers/678b2127-dbf6-4985-93ba-1171bae26d88" status: 204 len: 0 microversion: 2.1 time: 0.331927 Jan 28 02:19:20.222603 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 609/1261] 10.222.0.79 () {58 vars in 1238 bytes} [Fri Jan 28 02:19:19 2022] DELETE /compute/v2.1/servers/678b2127-dbf6-4985-93ba-1171bae26d88 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 28 02:19:20.240035 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-64d5f24d-ad6f-44b2-9b87-791a5989d804 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:19:20.240035 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-64d5f24d-ad6f-44b2-9b87-791a5989d804 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] [instance: 678b2127-dbf6-4985-93ba-1171bae26d88] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:19:20.242147 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-64d5f24d-ad6f-44b2-9b87-791a5989d804 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:19:20.242815 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-64d5f24d-ad6f-44b2-9b87-791a5989d804 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:19:20.243870 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-64d5f24d-ad6f-44b2-9b87-791a5989d804 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:19:20.244479 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-64d5f24d-ad6f-44b2-9b87-791a5989d804 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:19:20.454555 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-64d5f24d-ad6f-44b2-9b87-791a5989d804 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cdbf7d369e4437eae7a36529d6cd623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed8db325d13496c9a417966e33b10a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:19:20.465533 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-64d5f24d-ad6f-44b2-9b87-791a5989d804 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] 10.222.0.79 "GET /compute/v2.1/servers/678b2127-dbf6-4985-93ba-1171bae26d88" status: 200 len: 1574 microversion: 2.1 time: 0.237983 Jan 28 02:19:20.466116 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 653/1262] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:19:20 2022] GET /compute/v2.1/servers/678b2127-dbf6-4985-93ba-1171bae26d88 => generated 1574 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:19:21.484141 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-aecd25d3-0067-4087-add3-decebeffc9c9 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:19:21.484815 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-aecd25d3-0067-4087-add3-decebeffc9c9 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] [instance: 678b2127-dbf6-4985-93ba-1171bae26d88] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:19:21.490568 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-aecd25d3-0067-4087-add3-decebeffc9c9 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:19:21.491009 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-aecd25d3-0067-4087-add3-decebeffc9c9 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:19:21.491750 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-aecd25d3-0067-4087-add3-decebeffc9c9 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:19:21.492205 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-aecd25d3-0067-4087-add3-decebeffc9c9 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:19:21.628480 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.policy [None req-aecd25d3-0067-4087-add3-decebeffc9c9 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cdbf7d369e4437eae7a36529d6cd623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed8db325d13496c9a417966e33b10a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116375) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:19:21.628480 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-aecd25d3-0067-4087-add3-decebeffc9c9 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] 10.222.0.79 "GET /compute/v2.1/servers/678b2127-dbf6-4985-93ba-1171bae26d88" status: 200 len: 1456 microversion: 2.1 time: 0.147785 Jan 28 02:19:21.628756 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 610/1263] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:19:21 2022] GET /compute/v2.1/servers/678b2127-dbf6-4985-93ba-1171bae26d88 => generated 1456 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:19:22.645403 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-f9250daa-2192-45ab-bdaf-43fa9a496a57 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:19:22.646009 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-f9250daa-2192-45ab-bdaf-43fa9a496a57 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] [instance: 678b2127-dbf6-4985-93ba-1171bae26d88] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:19:22.652517 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-f9250daa-2192-45ab-bdaf-43fa9a496a57 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:19:22.652965 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-f9250daa-2192-45ab-bdaf-43fa9a496a57 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:19:22.653917 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-f9250daa-2192-45ab-bdaf-43fa9a496a57 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:19:22.654516 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-f9250daa-2192-45ab-bdaf-43fa9a496a57 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:19:22.833409 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [req-fed8ee87-4c8e-4407-b0ec-aa95720f181c req-b4284564-699f-41d1-873c-d4117052df04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "678b2127-dbf6-4985-93ba-1171bae26d88", "name": "network-vif-deleted", "tag": "41e411b1-116e-434d-a378-dd8425c82364"}]} {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 02:19:22.834983 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 02:19:22.834983 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: warnings.warn(msg) Jan 28 02:19:22.842796 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-fed8ee87-4c8e-4407-b0ec-aa95720f181c req-b4284564-699f-41d1-873c-d4117052df04 service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:19:22.844874 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [req-fed8ee87-4c8e-4407-b0ec-aa95720f181c req-b4284564-699f-41d1-873c-d4117052df04 service nova] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:19:22.850495 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-f9250daa-2192-45ab-bdaf-43fa9a496a57 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cdbf7d369e4437eae7a36529d6cd623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed8db325d13496c9a417966e33b10a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:19:22.857536 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.compute.server_external_events [req-fed8ee87-4c8e-4407-b0ec-aa95720f181c req-b4284564-699f-41d1-873c-d4117052df04 service nova] Creating event network-vif-deleted:41e411b1-116e-434d-a378-dd8425c82364 for instance 678b2127-dbf6-4985-93ba-1171bae26d88 on hv-cinder-82497 Jan 28 02:19:22.858383 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-f9250daa-2192-45ab-bdaf-43fa9a496a57 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] 10.222.0.79 "GET /compute/v2.1/servers/678b2127-dbf6-4985-93ba-1171bae26d88" status: 200 len: 1456 microversion: 2.1 time: 0.216541 Jan 28 02:19:22.859111 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 654/1264] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:19:22 2022] GET /compute/v2.1/servers/678b2127-dbf6-4985-93ba-1171bae26d88 => generated 1456 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:19:22.863241 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [req-fed8ee87-4c8e-4407-b0ec-aa95720f181c req-b4284564-699f-41d1-873c-d4117052df04 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033536 Jan 28 02:19:22.863831 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 611/1265] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Jan 28 02:19:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 02:19:23.875029 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-d46930b4-c35c-4d77-8c6d-f3d8a6436c0f tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:19:23.875627 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-d46930b4-c35c-4d77-8c6d-f3d8a6436c0f tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] [instance: 678b2127-dbf6-4985-93ba-1171bae26d88] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:19:23.881601 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-d46930b4-c35c-4d77-8c6d-f3d8a6436c0f tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:19:23.882052 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-d46930b4-c35c-4d77-8c6d-f3d8a6436c0f tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:19:23.882840 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-d46930b4-c35c-4d77-8c6d-f3d8a6436c0f tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:19:23.883281 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-d46930b4-c35c-4d77-8c6d-f3d8a6436c0f tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:19:23.917999 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-d46930b4-c35c-4d77-8c6d-f3d8a6436c0f tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:19:23.918471 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-d46930b4-c35c-4d77-8c6d-f3d8a6436c0f tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:19:23.918924 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.objects.instance [None req-d46930b4-c35c-4d77-8c6d-f3d8a6436c0f tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lazy-loading 'fault' on Instance uuid 678b2127-dbf6-4985-93ba-1171bae26d88 {{(pid=116374) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jan 28 02:19:23.958000 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.policy [None req-d46930b4-c35c-4d77-8c6d-f3d8a6436c0f tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cdbf7d369e4437eae7a36529d6cd623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed8db325d13496c9a417966e33b10a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116374) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 02:19:23.966368 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-d46930b4-c35c-4d77-8c6d-f3d8a6436c0f tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] 10.222.0.79 "GET /compute/v2.1/servers/678b2127-dbf6-4985-93ba-1171bae26d88" status: 200 len: 1229 microversion: 2.1 time: 0.095200 Jan 28 02:19:23.966939 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 655/1266] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:19:23 2022] GET /compute/v2.1/servers/678b2127-dbf6-4985-93ba-1171bae26d88 => generated 1229 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 02:19:24.558513 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 28 02:19:24.558766 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: Fri Jan 28 02:19:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 28 02:19:24.984597 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-29fcb63e-40f1-4a93-b0f4-d8d226967290 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:19:24.985309 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-29fcb63e-40f1-4a93-b0f4-d8d226967290 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] [instance: 678b2127-dbf6-4985-93ba-1171bae26d88] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:19:24.991527 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-29fcb63e-40f1-4a93-b0f4-d8d226967290 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:19:24.992014 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-29fcb63e-40f1-4a93-b0f4-d8d226967290 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:19:24.992785 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-29fcb63e-40f1-4a93-b0f4-d8d226967290 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:19:24.993234 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-29fcb63e-40f1-4a93-b0f4-d8d226967290 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:19:25.006871 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.wsgi [None req-29fcb63e-40f1-4a93-b0f4-d8d226967290 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] HTTP exception thrown: Instance 678b2127-dbf6-4985-93ba-1171bae26d88 could not be found. Jan 28 02:19:25.007452 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-29fcb63e-40f1-4a93-b0f4-d8d226967290 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Returning 404 to user: Instance 678b2127-dbf6-4985-93ba-1171bae26d88 could not be found. {{(pid=116375) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 02:19:25.008320 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-29fcb63e-40f1-4a93-b0f4-d8d226967290 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] 10.222.0.79 "GET /compute/v2.1/servers/678b2127-dbf6-4985-93ba-1171bae26d88" status: 404 len: 111 microversion: 2.1 time: 0.028071 Jan 28 02:19:25.008863 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 612/1267] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:19:24 2022] GET /compute/v2.1/servers/678b2127-dbf6-4985-93ba-1171bae26d88 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 28 02:19:25.562628 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-1aa02200-7b58-463b-845e-86da77868ce6 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Calling method '>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:19:25.563113 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.compute.api [None req-1aa02200-7b58-463b-845e-86da77868ce6 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] [instance: c405e3d0-6da8-4dac-9dc9-0c084024bb9f] Fetching instance by UUID {{(pid=116374) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:19:25.568977 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-1aa02200-7b58-463b-845e-86da77868ce6 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:19:25.570612 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-1aa02200-7b58-463b-845e-86da77868ce6 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:19:25.570612 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-1aa02200-7b58-463b-845e-86da77868ce6 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:19:25.570612 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG oslo_concurrency.lockutils [None req-1aa02200-7b58-463b-845e-86da77868ce6 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:19:25.583921 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.wsgi [None req-1aa02200-7b58-463b-845e-86da77868ce6 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] HTTP exception thrown: Instance c405e3d0-6da8-4dac-9dc9-0c084024bb9f could not be found. Jan 28 02:19:25.584578 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-1aa02200-7b58-463b-845e-86da77868ce6 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Returning 404 to user: Instance c405e3d0-6da8-4dac-9dc9-0c084024bb9f could not be found. {{(pid=116374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 02:19:25.585399 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-1aa02200-7b58-463b-845e-86da77868ce6 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] 10.222.0.79 "DELETE /compute/v2.1/servers/c405e3d0-6da8-4dac-9dc9-0c084024bb9f" status: 404 len: 111 microversion: 2.1 time: 0.026663 Jan 28 02:19:25.585924 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 656/1268] 10.222.0.79 () {58 vars in 1238 bytes} [Fri Jan 28 02:19:25 2022] DELETE /compute/v2.1/servers/c405e3d0-6da8-4dac-9dc9-0c084024bb9f => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 02:19:25.594617 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-bfb96a72-4eba-4c57-9c6c-c5ea24a8ce10 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Calling method '>' {{(pid=116375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:19:25.595328 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.compute.api [None req-bfb96a72-4eba-4c57-9c6c-c5ea24a8ce10 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] [instance: c405e3d0-6da8-4dac-9dc9-0c084024bb9f] Fetching instance by UUID {{(pid=116375) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 28 02:19:25.601451 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-bfb96a72-4eba-4c57-9c6c-c5ea24a8ce10 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:19:25.601885 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-bfb96a72-4eba-4c57-9c6c-c5ea24a8ce10 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:19:25.602643 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-bfb96a72-4eba-4c57-9c6c-c5ea24a8ce10 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 28 02:19:25.603065 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG oslo_concurrency.lockutils [None req-bfb96a72-4eba-4c57-9c6c-c5ea24a8ce10 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Lock "2ba5b9f5-d6f6-43f5-a12b-fc16048cf6e5" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 28 02:19:25.617067 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.wsgi [None req-bfb96a72-4eba-4c57-9c6c-c5ea24a8ce10 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] HTTP exception thrown: Instance c405e3d0-6da8-4dac-9dc9-0c084024bb9f could not be found. Jan 28 02:19:25.617645 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: DEBUG nova.api.openstack.wsgi [None req-bfb96a72-4eba-4c57-9c6c-c5ea24a8ce10 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Returning 404 to user: Instance c405e3d0-6da8-4dac-9dc9-0c084024bb9f could not be found. {{(pid=116375) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 02:19:25.618464 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO nova.api.openstack.requestlog [None req-bfb96a72-4eba-4c57-9c6c-c5ea24a8ce10 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] 10.222.0.79 "GET /compute/v2.1/servers/c405e3d0-6da8-4dac-9dc9-0c084024bb9f" status: 404 len: 111 microversion: 2.1 time: 0.027619 Jan 28 02:19:25.618995 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: [pid: 116375|app: 0|req: 613/1269] 10.222.0.79 () {58 vars in 1235 bytes} [Fri Jan 28 02:19:25 2022] GET /compute/v2.1/servers/c405e3d0-6da8-4dac-9dc9-0c084024bb9f => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 28 02:19:27.446573 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: DEBUG nova.api.openstack.wsgi [None req-11549fe5-dc45-4c04-bfe5-022123d859b7 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] Calling method '.version_select at 0x7f837c3b3d30>' {{(pid=116374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 02:19:27.547474 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO nova.api.openstack.requestlog [None req-11549fe5-dc45-4c04-bfe5-022123d859b7 tempest-TestVolumeBootPattern-1047067056 tempest-TestVolumeBootPattern-1047067056-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-710989458" status: 202 len: 0 microversion: 2.1 time: 0.104461 Jan 28 02:19:27.548083 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: [pid: 116374|app: 0|req: 657/1270] 10.222.0.79 () {58 vars in 1259 bytes} [Fri Jan 28 02:19:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-710989458 => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 02:19:37.373986 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 28 02:19:37.373986 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: Fri Jan 28 02:19:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 28 02:21:16.096590 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 28 02:21:16.097281 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: Fri Jan 28 02:21:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 28 02:21:29.507891 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 28 02:21:29.508678 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: Fri Jan 28 02:21:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 28 02:22:44.566652 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 28 02:22:44.567416 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: Fri Jan 28 02:22:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 28 02:22:57.399507 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 28 02:22:57.400285 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: Fri Jan 28 02:22:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 28 02:24:34.329448 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 28 02:24:34.330398 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: Fri Jan 28 02:24:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 28 02:24:36.104524 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 28 02:24:36.105271 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: Fri Jan 28 02:24:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 28 02:24:40.275319 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 28 02:24:40.276036 dv-cinder-824977-1-iscsi devstack@n-api.service[116375]: Fri Jan 28 02:24:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 28 02:24:49.516860 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 28 02:24:49.517416 dv-cinder-824977-1-iscsi devstack@n-api.service[116374]: Fri Jan 28 02:24:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!